I think the "with you" is implied: "Is it OK with you..."

I can't imagine a context in which someone would bother asking me for permission to rape my partner.