What Happens to Credit Card Rewards When You Return a Purchase?

You buy something, earn cash back or points on it, then decide it's not right and return it.