you're the boss

Etymology
In reference to the (actual or perceived) authority of the person one is responding to.