Lord love a duck

Etymology
Variant of earlier (18th century), God love us, etc. used as exclamation of exasperation or surprise. The significance of the duck is unknown. Attested from the late 19th century.