I, too, started sleeping with one HA on after my son was born and still keep this habit, though it is no longer necessary.
As for the speech processor, I always take it off for the night... Reason: first, after 24 sequential hours of wearing it its performance nearly falls to the floor; second, the magnet tends to fall off every time my head touches the pillow and the entire device seems to be rather fragile
