take one's eye off the ball

Etymology
From general sporting advice to look continuously at the ball as it moves.

Verb

 * 1)  To lose one's concentration on what is most important.