I tend to do most of the outings after her morning nap. She usually wakes up about 10:30/11:00, so I'll give her a feed and then do what I need to. When it comes to the doctor, I'd suggest feeding before hand (I usually make appointments for later in the day, rather than early in the morning) because you never know how long you're going to have to wait.
Also, I've heard that going for walks with bub in the afternoon is good at helping them sleep better at night (not sure if there's much truth to that, but maybe worth a try).
If you're worried about bub sleeping with visitors, maybe sleep bub in a quiet room or let people know when is usally a good time to visit that way both you and bub get some rest during the day.
Hope this helps...
Sam and Hayley and bub