Raising an old post, but I wanted to comment.
Specifically, travis' comment about associating the actual bits of speech to a concept is interesting. I find that, when I sign (I grew up hearing), I still begin to move my mouth for the word, even if I don't end up saying it, which ties in...