I think you need to see when is best to get on the off ramp. You had already said you wouldn’t make the joke again so there wasn’t a need to reply to Jeff again.
Even if you feel your response is right, just think will this help or is it over already if I don’t respond and do that.