buttare il bambino con l'acqua sporca

Verb

 * 1) to throw the baby out with the bathwater
 * 2)  to discard, especially inadvertently, something valuable while in the process of removing or rejecting something unwanted