Why are you using glossed words? That's not proper voicing technique. Like you said, using gloss sounds stupid (or at the very least unnatural).
Maybe you need more practice with your sign-to-voice skills?
You should be voicing with a vocabulary that fits the signer's tone, degree of formality, age, sex, and subject matter.