I've had CAPD since day zero. However, I've only known I have it for a couple of years. Before that, I was always the kid at school who "was easily distracted", the guy who's "away with the fairies" or the husband who "doesn't listen". CAPD really affects my relationship more than anything. I'm a software architect by trade, so I spend most of my time typing away on a keyboard. Occasionally, I have to have verbal meetings over Skype, but my colleagues know I'll "zone out" after a few minutes, so if I ask something dumb or miss vital information, they are usually pretty understanding.
As I said, the main area where CAPD causes me issues is with my wife. She's registered blind, so we make quite a pair. However, she has little tolerance with my CAPD, thinking that really, I'm just not paying attention. Fact is, I just find anything auditory (with the exception of music) as a mess that I can't store in memory, fully understand or pay particular attention to. It's almost like my vision is set in the real world and my ears are only dreaming.
I have my good days and bad days. Some days, I hardly know I have a problem, until my wife points out that someone has said something to me and I completely ignored them. I think it stresses her because she thinks they might believe I'm rude 
However, other days, sound is like white noise that stresses me out and I just wish I could become totally deaf for the rest of the day, so as to give my brain a rest.
I think, really, that's the biggest issue with CAPD. On the one hand, being really deaf would be a shame, as I love music and have quite an aptitude for it, while on the other hand, being totally deaf would mean an end to the dizzying white noise that somehow even manages to affect my vision.
It's interesting to hear that ASL makes a difference. I've been toying with the idea of learning sign language as a fall back for when things get bad, but as conversations are a two way street, I'm not sure how my blind wife will manage in conversation. I've also thought about trying a hearing aid, but have been told that they don't help much.
