I’m just making a guess here, but, I think they didn’t ask him to join because of his “reputation”. They might not have wanted to deal with any of that again. He did an interview where he was asked why he wasn’t cast and he said he didn’t know.
Still, even a cameo would have been nice, he was a...