combattre le mal par le mal

Verb

 * 1) to fight fire with fire

Usage notes
is found as well, but is less idiomatic.