I'm looking over what I can find, and it seems like Charles is getting stuck in this because of his defense of his brother, and proximity to Maxwell at events like this.
I think Andrew is the designated fall guy for the Brit Royal Family, so people do not try to dig deeper, like how Maxwell is...