Not its case, but its gender.
Native speakers learn not just the word, but its gender. For example, when a German child learns the word for "window", he simply learns "das Fenster" and not "Fenster". The word and its gender are inseperable. For us native English speakers, this is a...