Well "iffy" isn't supposed to be a holistic read - it's a "I have a small issue with what you identified because it indicates a lack of consideration for something I would expect you to consider, otherwise you're fine". I don't really think you believe I was handing you anything by voting for X by the way, beyond token support for pressure.
I think your read of him fails to consider what I've brought up, and I don't really think the "change in position" is inherently scummy, I think it's rather easy to make a player like that look bad if you're looking for ways to trip him up. I'm not saying you are, by the way, just that the way you've approached it could be that.