Y'all are nicer than me. I would have said thank you, marked the audit as declined, and been on my way.
I give whoever is there about 30 seconds IF they show any concern. My usual response to people who don't initially say "go for it" is "you get this at least every 3 months. It's no big deal."
99% of the time that takes care of it. It's usually the noobs that don't know that audits are a thing. If I get more pushback after that I tell them "it's up to you. I don't HAVE to do it" and that's their last chance.
I don't think I've ever been asked not to perform the audit.