I don't know about you, but I watched the whole game from start to finish on CBS. I saw some shots of the Fab 5 and a heard a few discussions, but I didn't miss one second of the game or feel slighted in the least because they attended. The cameras were on the game when they needed to be on the game, and the commentators knew they were commentating a basketball game and not a Fab Five reunion piece.
If you had troubles focusing on the game because they were in attendance and were getting too much "attention" (in your opinion), my guess is you are taking this situation way too personally. Enjoy the game, man. This thing doesn't happen often enough to let something take away from you the excitement of this experience.