One way to look at this question is to think of it as wearing glasses. Do you need glasses to read the road signs, street signs, or building numbers? If so, then you'd put a check saying yes you need to wear glasses when driving.
With hearing aids, the fact you have said you wear hearing aids most of the time, ask yourself why do you wear your hearings aids? Do you need to hear a car horn, ambulance siren, something wrong with your car engine, or what? If so, then you'd put a checkmark saying you need to wear hearing aids when driving.
It is a trick question though, because if you are pulled over for whatever reason and are not wearing your hearing aids when your license says you need them to drive you will get a ticket. I have the same situation, I don't wear my glasses much, but I need them to see far-off distance things like street signs and building numbers. I don't need them if I know where I am going and don't need to read the street signs or a hosue number so I don't bother wearing them, but if I am pulled over, then eep, I am caught and get a ticket!