Unitarity limits on thermal dark matter in (non-)standard cosmologies — arXiv2