Signing doesn’t have anything to do with speaking, really.
But an experienced signer would of course adapt their signing to be slower and more clear around new signers, if they want to be nice and facilitate communication.
Hearing people would try to speak more clearly around HoH/Deaf, and for example face them. But if you have a Deaf accent, the reason is that you don’t hear yourself clear enough to correct minor issues in pronunciation. If you don’t hear you cannot really control it, unless you try to improve your speech by going to speech therapy and someone else listens and helps you.