You mentioned weight classes as a reason for dismissing Bruce Lee as a serious and dangerous adversary for anyone walking the planet, so I harped on that.
To bring the topic back around to him a little more, his quickness combined with the velocity and impact of his punches and kicks means that yes, he would easily be a competent opponent for just about anyone, including whatever UFC "tough guy" you want to bring up. Believing he would get "taken apart in seconds" is ridiculously hilarious. He had lightning fast speed and the only way he's getting dragged down to the mat and "grounded and pounded" or having a submission slapped on him is if his opponent is faster than he is and is able to outmaneuver him in such a way, and there's no guarantee that would happen. Landing more than just a few good punches and kicks to the face would be enough to cause his opponent to stagger, which would obviously tilt the fight in his favor. It's all about utilizing your strengths and hiding/evading your weaknesses.