test someone's patience

Verb

 * 1)  To begin to frustrate someone.