The Imperials are objectively the better option IMO. The Stormcloaks are basically xenophobic against anything that isn't a Nord and on top of that they would be fucking steamrolled in whatever war were to come next. The Talos ban by the Imperials is heavily implied to be temporary and out of necessity to keep Skyrim alive and would likely (although yes not guaranteed) be reversed. Imperials also have a far better economic and military infrastructure that would give Skyrim a much higher chance of at least surviving the next war they're in. Also, while not perfect, non-Nords would face far less discrimination under Imperial rule. Let's also not forget that the Civil War, caused by the Stormcloaks, is actively helping the Thalmor by weakening both sides of a fractured Skyrim.
As much as I am the opposite in real life, if this were real, I'd 100% side with the Imperials. However, neither side is completely good and I'd hate both regardless of the side I'd be on in that situation.