I've heard something like that before; 'an idle mind is the devil's workshop'. I used to hear that one in church too.

Yes, it's ok to slow down from time to time. It can even be a great recharge technique.