fly-by-night

Noun

 * 1) A creature which flies at night; a nocturnal flier or traveler.
 * 2)  One who departs or flees at night in order to avoid creditors, law enforcement etc.
 * 3)  A person or business that appears and/or disappears rapidly, appearing untrustworthy, or giving an impression of transience.
 * 4)  A traveling businessman or tradesman.
 * 1)  A traveling businessman or tradesman.
 * 1)  A traveling businessman or tradesman.
 * 1)  A traveling businessman or tradesman.
 * 1)  A traveling businessman or tradesman.

Usage notes
The phrase implies that the quality of work done or goods sold is shoddy enough that the person responsible must leave town under cover of darkness to evade angry customers, or sometimes legal authorities. The earliest use of the phrase is said to have been a reproach for women, signifying that she was a witch. The modern usage first appeared in 1823.