Yes and No. It can happen but at the same time it can all work out. It all depends on who will show up and if they are all anti-student or welcoming. I don't mind it when students come to the socials, what pisses me off is when they try to correct me if I sign something in a different way (like pizza or whatever).
Basically instead of asking them, "oh what's the sign for this word", just try to talk with them and tell a story or just listen to them talk. If that is too much for you just watch them from a distance and keep your mouth shut. Hee hee