Does the NCAA have too much power?

With all these anti-government groups rebelling lately, I'm surprised the same kind of rebellion hasn't taken place against the NCAA. The NCAA can take a minor infraction, open up a can of worms, then shut down a great program if they have a worker who wants to make a name for themselves. At least the government tries to help people. The NCAA seems to be on a power trip that is damaging, unjust and overbearing that shuts down great programs. It's not about what's best for the university or college sports. It's about fearing the NCAA or they'll shut you down. I've always wondered why more people don't rebel against the NCAA. I'm also surprised that there haven't been lawsuits against the NCAA for unjust, excessive power. Well there's always a first time. If the NCAA does put the U of M football program on probation, wouldn't you think there would be at least one lawyer out there from U of M that would finally challenge the NCAA for damaging athletic programs?