keep one's knickers on

Verb

 * 1)  To stay calm; to not get flustered or angry.
 * Keep your knickers on, mate. It was only a joke.