Nothing more boring than a static shot. And if someone paces, you have to zoom out so far to keep that static shot that you're left with a static shot of a huge space with a tiny person pacing through it.
I would error on the side of too much motion before I would error on the side of the huge empty static shot. However, if you're going to zoom in and follow someone that paces, you really have to stay on top of your framing. Never let them walk out of the frame and always give them plenty of leading when they're moving left or right in the frame (as I explain to new camera ops, if they're looking or moving to the left, make sure you give them plenty of frame to look or walk into.)
I'm running one camera now and my pastor is all over the place. Believe me,
I feel your pain.