Don't worry about it too much. Some deaf do mouth most words, some deaf don't mouth at all and some deaf mouth some words. All is different, you do what you feel comfortable when you sign.
When you watch someone sign, instead of trying focus on one area (lips or hands), try look whole area of...