Will User Review scores ever become more reliable?

This topic is locked from further discussion.

Avatar image for ptrpedrohung
ptrpedrohung

189

Forum Posts

0

Wiki Points

0

Followers

Reviews: 10

User Lists: 0

#1  Edited By ptrpedrohung
Member since 2009 • 189 Posts

I know what you're gonna say: of course not! The user score sections on MetaCritic and Gamespot are always gonna be filled with 10s and 0s with one liner comments, or that it could be easily manipulated. But I think as we are more enthusiastic about games and start taking them very seriously, maybe we will be more careful about what we say about them on the Internet.

At the same time, a Feedbacula style observation about general user comment trends can say something about both the games and about ourselves too. Would that be a more accurate measurement on how people are likely to experience a game?

Please bring back Feedbacula, I fucking love that show!

Avatar image for loafofgame
loafofgame

1742

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#2 loafofgame
Member since 2013 • 1742 Posts
@ptrpedrohung said:

But I think as we are more enthusiastic about games and start taking them very seriously, maybe we will be more careful about what we say about them on the Internet.

I don't think that's how it works, but I applaud your optimism. People already take games seriously, maybe even too seriously. So seriously, in fact, that people are unable to think straight. Users don't have to feel responsible for what they say, because they're not getting paid, don't have a large and returning audience and because expressing an opinion is more important than carefully constructing one. Besides, users will always be significantly supported in their opinion by other users, so there's also no incentive to be critical of one's own perspective or consider other perspectives. I think the situation will remain the way it is: a lot of crap with occasional useful content.

Avatar image for Minishdriveby
Minishdriveby

10519

Forum Posts

0

Wiki Points

0

Followers

Reviews: 23

User Lists: 0

#3  Edited By Minishdriveby
Member since 2006 • 10519 Posts

The aggregate score is pretty accurate on metacritic, especially if the sample size is large. Those scores usually give a general feeling of the feedback the gaming community has on games, despite people rating things a 0 or a 10.

Edit: Of course interpretation of a number scale is extremely subjective, and numbers don't mean anything by themselves; you need context.

Avatar image for turtlethetaffer
turtlethetaffer

18973

Forum Posts

0

Wiki Points

0

Followers

Reviews: 144

User Lists: 0

#4 turtlethetaffer
Member since 2009 • 18973 Posts

The internet is a tool. A tool given to anyone... ANYONE... with an opinion. All they need is access. And in this day and age, that's almost impossible not to have. And as long as there are idiots and over hyper people in the world, user scores will always be slightly off.

Avatar image for Cloud_imperium
Cloud_imperium

15146

Forum Posts

0

Wiki Points

0

Followers

Reviews: 103

User Lists: 8

#6 Cloud_imperium
Member since 2013 • 15146 Posts

Sometimes user reviews are more reliable than paid reviews from critics .

Avatar image for ptrpedrohung
ptrpedrohung

189

Forum Posts

0

Wiki Points

0

Followers

Reviews: 10

User Lists: 0

#7 ptrpedrohung
Member since 2009 • 189 Posts

@geniobastardo: What if we abandon the 0 to 10 system and replace it with something more like Kotaku's "should or should you not play this game?"

Avatar image for Jacanuk
Jacanuk

20281

Forum Posts

0

Wiki Points

0

Followers

Reviews: 42

User Lists: 0

#8 Jacanuk
Member since 2011 • 20281 Posts

@ptrpedrohung said:

I know what you're gonna say: of course not! The user score sections on MetaCritic and Gamespot are always gonna be filled with 10s and 0s with one liner comments, or that it could be easily manipulated. But I think as we are more enthusiastic about games and start taking them very seriously, maybe we will be more careful about what we say about them on the Internet.

At the same time, a Feedbacula style observation about general user comment trends can say something about both the games and about ourselves too. Would that be a more accurate measurement on how people are likely to experience a game?

Please bring back Feedbacula, I fucking love that show!

Your question is the same as asking "will there ever stop being fanboys and trolls" and if you think no of course not, then you have your answer.

But also who really cares about the userscore? or do they really have a impact on your decision on your purchase?

Avatar image for marcheegsr
marcheegsr

3115

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#9 marcheegsr
Member since 2004 • 3115 Posts

I tend to ignore user reviews because everyone has their own taste and opinion. All that matters is what YOUR opinion is.

Avatar image for Grieverr
Grieverr

2835

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#10 Grieverr
Member since 2002 • 2835 Posts

@ptrpedrohung said:
What if we abandon the 0 to 10 system and replace it with something more like Kotaku's "should or should you not play this game?"

I think that's what scores need to move towards. This 0 - 10 scale is just not functional. To me, a 5 is an average game. That means it's like many other games out there - not necessarily a bad thing. But no one wants to look at games that get less than an 8. And at least Gamespot does whole numbers. Other sites that award decimal points kill me. What's the difference between an 8.2 and an 8.3?!

I liked X-Play's 5 point system. Very simple, but effective. Hotels and restaurants go by a 5 star system as well.

Avatar image for ptrpedrohung
ptrpedrohung

189

Forum Posts

0

Wiki Points

0

Followers

Reviews: 10

User Lists: 0

#11 ptrpedrohung
Member since 2009 • 189 Posts

@Jacanuk said:

@ptrpedrohung said:

I know what you're gonna say: of course not! The user score sections on MetaCritic and Gamespot are always gonna be filled with 10s and 0s with one liner comments, or that it could be easily manipulated. But I think as we are more enthusiastic about games and start taking them very seriously, maybe we will be more careful about what we say about them on the Internet.

At the same time, a Feedbacula style observation about general user comment trends can say something about both the games and about ourselves too. Would that be a more accurate measurement on how people are likely to experience a game?

Please bring back Feedbacula, I fucking love that show!

Your question is the same as asking "will there ever stop being fanboys and trolls" and if you think no of course not, then you have your answer.

But also who really cares about the userscore? or do they really have a impact on your decision on your purchase?

I think userscore can be a way to dilute professional critics' genre bias or personal preference. Like here in GameSpot, guys like Tom McShea has very strong opinion about certain genres or games with certain messages. In that case user score can be referenced side by side with the critics' opinion to give you a more balanced picture.

Avatar image for udubdawgz1
udUbdaWgz1

633

Forum Posts

0

Wiki Points

0

Followers

Reviews: 4

User Lists: 5

#13 udUbdaWgz1
Member since 2014 • 633 Posts

I think the entire comment made by the op is an incorrect assumption. the only reviews I find worthy of any true knowledge of a game is from user reviews. the "pro" reviews rarely give me the actual info I want in a review.

I think the problem is the op mistakenly connects all user reviews into one big bunch. meaning, the worthless 10's and 0's and everything in-between. the simple, common-sense answer is that some reader reviews are worthless and others are not. for me, almost all "pro" reviews stink.

I could care less about angry joe, feedbacula, gamespot, whomever, whatever. the only thing that matters is the words in the review and whether or not they address the different aspects of a game.

and, when I read the MANY different reader reviews that are done well I am able to get an absolutely crystal clear picture of what a game has, doesn't have and whether or not the game fits my style.

"pro" reviews are usually always a waste of my time.

Avatar image for turtlethetaffer
turtlethetaffer

18973

Forum Posts

0

Wiki Points

0

Followers

Reviews: 144

User Lists: 0

#14 turtlethetaffer
Member since 2009 • 18973 Posts

@marcheegsr: I read user reviews to help with research. Often, I'll read negative reviews and determine from the way it is written if it's legit or not. Since negative reviews focus on the bad parts of a game, reading about the issues in a game can help me determine if I'm going to like a game or not.

Avatar image for Demonjoe93
Demonjoe93

9869

Forum Posts

0

Wiki Points

0

Followers

Reviews: 107

User Lists: 0

#15 Demonjoe93
Member since 2009 • 9869 Posts

Well, I try to write good user reviews. I have noticed that a lot of user reviews are poorly written and too short to give a real good idea about how good the game is.

Avatar image for Archangel3371
Archangel3371

44163

Forum Posts

0

Wiki Points

0

Followers

Reviews: 4

User Lists: 0

#16 Archangel3371
Member since 2004 • 44163 Posts

I doubt it, well for me at least. Personally I never look at user reviews, I prefer to use professional reviews in my game purchasing decisions.

Avatar image for ptrpedrohung
ptrpedrohung

189

Forum Posts

0

Wiki Points

0

Followers

Reviews: 10

User Lists: 0

#17 ptrpedrohung
Member since 2009 • 189 Posts

@Demonjoe93: By doing that, you are making the world a better place. And I think people like you is why I'm so optimistic about why User Reviews will be more and more important.

Avatar image for Netret0120
Netret0120

3594

Forum Posts

0

Wiki Points

0

Followers

Reviews: 3

User Lists: 0

#18 Netret0120
Member since 2013 • 3594 Posts

@Archangel3371 said:

I doubt it, well for me at least. Personally I never look at user reviews, I prefer to use professional reviews in my game purchasing decisions.

This and I can read certain user reviews from dependable people who many people listen to. IGN isn't entirely reliable because certain companies fund them so it is only best for business that they inflate their scores.

A good combination of professional reviews, user reviews and forum posts will give you a feel of a game.

Avatar image for loafofgame
loafofgame

1742

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#19 loafofgame
Member since 2013 • 1742 Posts

@ptrpedrohung
said:

I think userscore can be a way to dilute professional critics' genre bias or personal preference. Like here in GameSpot, guys like Tom McShea has very strong opinion about certain genres or games with certain messages. In that case user score can be referenced side by side with the critics' opinion to give you a more balanced picture.

I don't know. Sounds to me like you want to dilute bias with more bias. User reviews will remain as important as they are at the moment. Some of them are useful, most of them are questionable. There's no indication whatsoever that the majority of people will develop towards a more (self-)critical and/or balanced approach. If anything, the growing tendency to express an opinion in as little words as possible might even make the situation worse...

Avatar image for Lulu_Lulu
Lulu_Lulu

19564

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#20 Lulu_Lulu
Member since 2013 • 19564 Posts

So many things are being distilled into a number (or numbers).

Remember when people use to read the reviews regardless of the score ?........ Yeah, me neither.

Avatar image for Demonjoe93
Demonjoe93

9869

Forum Posts

0

Wiki Points

0

Followers

Reviews: 107

User Lists: 0

#21 Demonjoe93
Member since 2009 • 9869 Posts

@ptrpedrohung said:

@Demonjoe93: By doing that, you are making the world a better place. And I think people like you is why I'm so optimistic about why User Reviews will be more and more important.

Thanks!

Avatar image for Old_Gooseberry
Old_Gooseberry

3958

Forum Posts

0

Wiki Points

0

Followers

Reviews: 76

User Lists: 0

#22 Old_Gooseberry
Member since 2002 • 3958 Posts

I read user reviews usually more then anything. People have nothing to gain from it so i trust them. Gamespot reviews are under pressure to sound professional, not to piss anyone off and to keep their advertisers happy for the most part... so they cannnot be trusted sometimes.