Astarion did not think at any point that John enjoyed butting in and exercising his influence as his warden. The fact that he did it anyway is actually kind of worse? But he's already exhausted by this conversation.

"...Why would I believe that you'd have fucked off back then, when I am trying to make you fuck off right now and you refuse?"