I sympathize. It definitely sucks when you can't follow the conversation. With me, forget it if there's a group of people talking. One-on-one, I have a better chance of understanding someone speaking. (Not guaranteed, though.)
What kind of hearing loss do you have? Is it moderate...