Sound Quality Noticeably Drops When Only Using One Earbud

I'm having an issue where the sound quality of the Vistas noticeably plummets when one earbud is in the case. Anyone find a solution to this? I'm thinking of returning them for the Jabra Elite 75t.