A lot of the time spent 'designing' is done in my head. It's more problem solving. The actual getting thoughts onto paper or screen is pretty quick.
I often find that my best problem solving thinking is done away from the screen, and away from the office. Most difficult problems are usually solved when I'm walking with my dog, Mia, or when my head is somewhere completely different.