From what I understand, wedding rings and engagement rings are considered a gift. I got to keep mine during my divorce, and my husband's ex got to keep hers, and he STILL owes on it(they just garnished his wages for it... .ugh).
It's pretty silly that he doesn't understand that your fingers are swollen. My niece did wear hers on a necklace when she was pregnant, and I mentioned she needed a heavier chain, as did her husband, because she has an expensive ring, and it was on a flimsy chain. The point is though, he husband would have been understanding of her not wearing it(and he sure didn't want her to lose it... .

).
Have you looked around for it? I wonder if he took it to work? I'd have myself a mad hunt for it and find it! It probably feels like he is doing it to punish you.