I, probably more than anyone else, appreciate that the new site has a way to search by Member Score. However, I have certain concerns with the feature:
1) Many games don't seem to be displayed in the proper order. For example, if I do a search for all Atari 2600 games by Members Score, "Frogger" is the first game listed, which has an 8.1 Average Player Score for the 2600. There are many 2600 games that have a higher Average Player Score than 8.1.
2) Many multi-platform games have no breakdown at all. For example, if you try to see what the platform-specific Average Player Score is for "Resident Evil 4," you get a message "We have no player reviews for Resident Evil 4 yet."
3) For many other multi-platform games, the aggregate number of platform-specific user ratings falls far short of the total userratings, and it's not clear where those user ratings went. For example, "SoulCalibur" has 3,364 user ratings, but if you try to break it down by platform, you get 766 ratings for the Dreamcast version and 1 rating for the IP version. There's also an arcade version, but you can't see the breakdown... and I find it hard to believe that the arcade version would account for the missing 2,597 user ratings.
4) For many, multi-platform releases, the vast majority of platform-specific user ratings appear to have been assigned to one platform. This may be related to the fact that the new site doesn't permit you to rate a game by platform unless you write a review (the old site, from my understanding, had no such restrictions). As an example, "Batman: Arkham Asylum" has 18,748 user ratings for the X360 version, but only 1,854 user ratings for the PS3 version. I find it hard to believe that 10 times as many people rated the game for X360 than for PS3.
I know at some point, edgework and others at Gamespot were working on this, but the last I heard on it was that Gamespot felt that the user review breakdowns were 90% more accurate now than on the previous site. I simply don't think that's true, and I can find hundreds of examples like the ones I site above. I suspect that the site change may have wiped out some data about which ratings were assigned to which platform, and that this is the best Gamespot can do now. I don't have a problem with that (well, it's sad, but it is what it is), but I'd like to at least know that this is as good as we're going to get. Thanks in advance if anyone from the site addresses this topic!