Sometimes, the only way is be proactive with your deafness to show people what you're really going through or they'll never understand and assume you for what they think of you.
Life's tough.
But in the end, if you find people or friends (in general) who aren't willing to turn on captions for you after you asked, they are probably not friends you want to hang out in the long term anyways.. Family's a different story completely, it's tough to confront loved ones who don't understand you.
Good thing your vacation went through nonetheless, any new ones next time?