Although those retail companies represent a much smaller proportion of the market than the bank-issued cards, no business has a right to gouge. Government, in this area of access to credit, has a particular role to play in terms of ensuring that everyone is treating everyone fairly and well at fair prices and fair interest rates.
So send in the auditors to the divisions of those companies as well, and require them to prove that they are making a reasonable profit from their credit card divisions.