Very interesting article on Edge review scores

It shows what I, and many others, have known all along.

Notice the data in this article is an inarguable fact. You are free to form your own opinions on that data, but it is pretty damning.

N4G.com : Does a game's platform influence its EDGE score?

We have know this since the guy on here posted his chart. It's so obvious now it's not funny. This guy went into alot greater length though so I commend him. Edge is biased toward the 360 end of story. The same BS they call on Ps3 exclusives they conveniently forget on 360 exclusives.

fanboy blog doesn't mean anything but venomous rage trying to prove a point through flawed datablue_hazy_basic

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

[QUOTE="blue_hazy_basic"]fanboy blog doesn't mean anything but venomous rage trying to prove a point through flawed dataEspada12

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

[QUOTE="Espada12"]

[QUOTE="blue_hazy_basic"]fanboy blog doesn't mean anything but venomous rage trying to prove a point through flawed datablue_hazy_basic

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

Explain how please? Also if I was a fanboy and wrote the 360 has an extremely high fail rate does that somehow not make it true?

[QUOTE="Espada12"]

[QUOTE="blue_hazy_basic"]fanboy blog doesn't mean anything but venomous rage trying to prove a point through flawed datablue_hazy_basic

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

It's not flawed if it provides accurate statistics, which it does.

[QUOTE="blue_hazy_basic"][QUOTE="Espada12"]

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

Espada12

Explain how please? Also if I was a fanboy and wrote the 360 has an extremely high fail rate does that somehow not make it true?

[QUOTE="blue_hazy_basic"][QUOTE="Espada12"]

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

It's not flawed if it provides accurate statistics, which it does.

[QUOTE="Espada12"]

[QUOTE="blue_hazy_basic"] yes it is flawed and yes it does make it less trueblue_hazy_basic

Explain how please? Also if I was a fanboy and wrote the 360 has an extremely high fail rate does that somehow not make it true?

Wow that's some logic you got there, it's not as though metacritic is a collection of everyone else scores.....

[QUOTE="Espada12"]

[QUOTE="blue_hazy_basic"]fanboy blog doesn't mean anything but venomous rage trying to prove a point through flawed datablue_hazy_basic

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

[QUOTE="BigBoss154"]

[QUOTE="blue_hazy_basic"] yes it is flawed and yes it does make it less trueblue_hazy_basic

It's not flawed if it provides accurate statistics, which it does.

What? Did you even read the thing? He took the top 30 of each system and even counted 360/PC games as exclusives he even included multiplats. How is that selective choosing?

[QUOTE="blue_hazy_basic"]

[QUOTE="Espada12"]

Explain how please? Also if I was a fanboy and wrote the 360 has an extremely high fail rate does that somehow not make it true?

Espada12

Wow that's some logic you got there, it's not as though metacritic is a collection of everyone else scores.....

I like how the conclusion of this article is that "EDGE scores can not be taken at face value." I don't take ANY review scores at face value. I think anyone who does follow review scores/grades isn't any more credible than the very people they are accusing of bias in the first place.

Anyone with a brain should READ THE REVIEW ARTICLES and then take the pros and cons of the game and think about how it would affect their own experience.

[QUOTE="BigBoss154"]

[QUOTE="blue_hazy_basic"] yes it is flawed and yes it does make it less trueblue_hazy_basic

It's not flawed if it provides accurate statistics, which it does.

[QUOTE="blue_hazy_basic"]fanboy blog doesn't mean anything but venomous rage trying to prove a point through flawed dataEspada12

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

It is inherently flawed given the scoring system employed by EDGE. Sometime as simple as the week that a game is scored could drop the scores from EDGE because they do not have a single scoring criteria beyond "Whatever you feel like giving it."

For all we know, Sony could send review copies to PS3 exclusives towards the end of the magazine cycle when the EDGE reviewers are under a lot more stress and would be more easily aggravated.

Also, all this proves is a correlation, not a causation. Until you can prove a causal link between the platform and the score, all you have here is an ultimately insignificant trend. The meat behind a review in EDGE is what is written. Can't say that for a number of other review sources, but it IS the case for EDGE.

[QUOTE="BigBoss154"]

[QUOTE="blue_hazy_basic"] yes it is flawed and yes it does make it less trueblue_hazy_basic

It's not flawed if it provides accurate statistics, which it does.

[QUOTE="Espada12"]

[QUOTE="blue_hazy_basic"] Jesus, you can use slanted statistics to make any case you want. Metacritic consistently uses scores for PS3 exclusives that are slanted - Case in point PS3 exclusives are 12 pts higher on average on metacritic than Edge therefore metacritic is biased. :roll:

blue_hazy_basic

Wow that's some logic you got there, it's not as though metacritic is a collection of everyone else scores.....

I wasn't either, you seem to try to make it seem as though metacritic was one reviewer hence you stating "PS3 exclusives are 12 pts higher on average on metacritic than edge therefore metacritic was biased". Which is why I said that's some nice logic there..

I like how the conclusion of this article is that "EDGE scores can not be taken at face value." I don't take ANY review scores at face value. I think anyone who does follow review scores/grades isn't any more credible than the very people they are accusing of bias in the first place.

Anyone with a brain should READ THE REVIEW ARTICLES and then take the pros and cons of the game and think about how it would affect their own experience.

ZIMdoom

I like how the conclusion of this article is that "EDGE scores can not be taken at face value." I don't take ANY review scores at face value. I think anyone who does follow review scores/grades isn't any more credible than the very people they are accusing of bias in the first place.

Anyone with a brain should READ THE REVIEW ARTICLES and then take the pros and cons of the game and think about how it would affect their own experience.

ZIMdoom

This is nice and all to say but in reality we know alot of people just look at scores...

the part i immediately disagree with is when he compares a site's scores to metacritic averages

particularly because using averages negates whether Edge is clearly unique in their scoring or not, ie: if Edge and 10 other websites feel X game sucks, but 20 websites feel X game rocks their socks off, the average will end up looking bad for Edge

i also think it's a disservice towards the value of personal opinion, since an average of genuinely made-up scores (since very few websites use any kind of mathematical/scientific method for scoring) can vary from site to site just simply based on who it is doing the judging, a score is always simply attached as a "generalization" of a review, but it's always the content of a review that matters more

[QUOTE="Espada12"]

[QUOTE="blue_hazy_basic"]fanboy blog doesn't mean anything but venomous rage trying to prove a point through flawed dataKingsMessenger

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

It is inherently flawed given the scoring system employed by EDGE. Sometime as simple as the week that a game is scored could drop the scores from EDGE because they do not have a single scoring criteria beyond "Whatever you feel like giving it."

For all we know, Sony could send review copies to PS3 exclusives towards the end of the magazine cycle when the EDGE reviewers are under a lot more stress and would be more easily aggravated.

Also, all this proves is a correlation, not a causation. Until you can prove a causal link between the platform and the score, all you have here is an ultimately insignificant trend. The meat behind a review in EDGE is what is written. Can't say that for a number of other review sources, but it IS the case for EDGE.

[QUOTE="blue_hazy_basic"][QUOTE="BigBoss154"]

It's not flawed if it provides accurate statistics, which it does.

Xalaten

the part i immediately disagree with is when he compares a site's scores to metacritic averages

particularly because using averages negates whether Edge is clearly unique in their scoring or not, ie: if Edge and 10 other websites feel X game sucks, but 20 websites feel X game rocks their socks off, the average will end up looking bad for Edge

i also think it's a disservice towards the value of personal opinion, since an average of genuinely made-up scores (since very few websites use any kind of mathematical/scientific method for scoring) can vary from site to site just simply based on who it is doing the judging

88mphSlayer

The thing is edge is not unique in their scoring unless it's a PS3 exclusive, their review scores for 360 exclusives either fall in line or exceed metacritic's average, so it's not matter of they have a different review style.

Wow, cry me a river. Theyre entitled to their opinions.

EDGE pre dates this generation. so were they biased against the PS2 or PS or N64 or Saturn. or have they just decided to become biased against the PS3 for a laugh.

or is this fatuous paranoia?

[QUOTE="blue_hazy_basic"][QUOTE="BigBoss154"]

It's not flawed if it provides accurate statistics, which it does.

Xalaten

Metascoring is broken because it fails to account for reviewing scales, review content, or any number of other factors. It is good at showing trends, but do not try to pretend that a metascore from one platform can be accurately compared to a metascore from another platform. Or even comparing game to game for that matter. It just isn't reliable for a direct comparison.

the part i immediately disagree with is when he compares a site's scores to metacritic averages

particularly because using averages negates whether Edge is clearly unique in their scoring or not, ie: if Edge and 10 other websites feel X game sucks, but 20 websites feel X game rocks their socks off, the average will end up looking bad for Edge

i also think it's a disservice towards the value of personal opinion, since an average of genuinely made-up scores (since very few websites use any kind of mathematical/scientific method for scoring) can vary from site to site just simply based on who it is doing the judging

88mphSlayer

EDGE pre dates this generation. so were they biased against the PS2 or PS or N64 or Saturn. or have they just decided to become biased against the PS3 for a laugh.

or is this fatuous paranoia?

dog_dirt

[QUOTE="KingsMessenger"]

[QUOTE="Espada12"]

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

Xalaten

It is inherently flawed given the scoring system employed by EDGE. Sometime as simple as the week that a game is scored could drop the scores from EDGE because they do not have a single scoring criteria beyond "Whatever you feel like giving it."

For all we know, Sony could send review copies to PS3 exclusives towards the end of the magazine cycle when the EDGE reviewers are under a lot more stress and would be more easily aggravated.

Also, all this proves is a correlation, not a causation. Until you can prove a causal link between the platform and the score, all you have here is an ultimately insignificant trend. The meat behind a review in EDGE is what is written. Can't say that for a number of other review sources, but it IS the case for EDGE.

EDGE tried to drop giving games scores all together but people complained and moaned for months. So, they brought it back. They just don't take it seriously at all. So cry me a river. EDGE doesn't want to give scores in the first place, but fanboys demanded that scores come back, so now they just throw gut reaction scores at games. If that causes a "negative effect" then people should get over it. There is significant proof that metascores have no substantial effect on the long term success of a game. So it really doesn't matter to ANYONE, except for the fanboys who want to compare insignificant data so they can prove that they are "better than each other"

I suggest everyone dons tin foil hats before Edge starts to affect us all!

[QUOTE="Xalaten"][QUOTE="KingsMessenger"]

It is inherently flawed given the scoring system employed by EDGE. Sometime as simple as the week that a game is scored could drop the scores from EDGE because they do not have a single scoring criteria beyond "Whatever you feel like giving it."

For all we know, Sony could send review copies to PS3 exclusives towards the end of the magazine cycle when the EDGE reviewers are under a lot more stress and would be more easily aggravated.

Also, all this proves is a correlation, not a causation. Until you can prove a causal link between the platform and the score, all you have here is an ultimately insignificant trend. The meat behind a review in EDGE is what is written. Can't say that for a number of other review sources, but it IS the case for EDGE.

KingsMessenger

EDGE tried to drop giving games scores all together but people complained and moaned for months. So, they brought it back. They just don't take it seriously at all. So cry me a river. EDGE doesn't want to give scores in the first place, but fanboys demanded that scores come back, so now they just throw gut reaction scores at games. If that causes a "negative effect" then people should get over it. There is significant proof that metascores have no substantial effect on the long term success of a game.

[QUOTE="88mphSlayer"]

the part i immediately disagree with is when he compares a site's scores to metacritic averages

particularly because using averages negates whether Edge is clearly unique in their scoring or not, ie: if Edge and 10 other websites feel X game sucks, but 20 websites feel X game rocks their socks off, the average will end up looking bad for Edge

i also think it's a disservice towards the value of personal opinion, since an average of genuinely made-up scores (since very few websites use any kind of mathematical/scientific method for scoring) can vary from site to site just simply based on who it is doing the judging

Espada12

The thing is edge is not unique in their scoring unless it's a PS3 exclusive, their review scores for 360 exclusives either fall in line or exceed metacritic's average, so it's not matter of they have a different review style.

the problem is the guy shows zero evidence that Edge is unique in their scoring of ps3 exclusives

nor does it negate the fact that Edge is not unique in downscoring 360 exclusives either

whether or not there is someinherentbias, maybe, all sites and publications are reviewing based on personal opinion, but i think it has less to do with personal taste in console and more to do with personal taste in games, as they've given higher than average scores for the PS3 as well

[QUOTE="dog_dirt"]

EDGE pre dates this generation. so were they biased against the PS2 or PS or N64 or Saturn. or have they just decided to become biased against the PS3 for a laugh.

or is this fatuous paranoia?

Xalaten

Most of EDGE's subscriptions are international subscriptions. They have a following in the UK, but it is HARDLY their primary market. Not just that, but the vast majority of their subscribers are industry insiders that don't really care about the entire fanboyish war going on.

[QUOTE="KingsMessenger"]

[QUOTE="Xalaten"]

EDGE tried to drop giving games scores all together but people complained and moaned for months. So, they brought it back. They just don't take it seriously at all. So cry me a river. EDGE doesn't want to give scores in the first place, but fanboys demanded that scores come back, so now they just throw gut reaction scores at games. If that causes a "negative effect" then people should get over it. There is significant proof that metascores have no substantial effect on the long term success of a game.

Xalaten

correlation not causation. Seriously, PLEASE learn the difference. Seriously... If you think that the freaking metascore is the deciding factor on whether or not most people purchase a game.... Well, I can't help you if you think that.

Edit - Added a wikipedia link that I think rather accurately sums up how correlation does not prove causation. Just because data trends align does not mean that they are directly linked. There are numerous other factors involved, and unless you can isolate two variables to compare data trends, all you have is two similar data sets that mean nothing statistically or scientifically.

Perfect Quote

With a decrease in the number of pirates, there has been an increase in global warming over the same period.Therefore, global warming is caused by a lack of piratesWikipedia

I think it's a little unfair to be crying 'tinfoil hats!' over this....the data seems pretty sound. I'm not suggesting Microsoft is in league with Edge, but is it really impossible that Edge employs a few 360 fanboys...no, no it's not.

[QUOTE="Espada12"]

[QUOTE="blue_hazy_basic"]fanboy blog doesn't mean anything but venomous rage trying to prove a point through flawed dataKingsMessenger

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

It is inherently flawed given the scoring system employed by EDGE. Sometime as simple as the week that a game is scored could drop the scores from EDGE because they do not have a single scoring criteria beyond "Whatever you feel like giving it."

For all we know, Sony could send review copies to PS3 exclusives towards the end of the magazine cycle when the EDGE reviewers are under a lot more stress and would be more easily aggravated.

Also, all this proves is a correlation, not a causation. Until you can prove a causal link between the platform and the score, all you have here is an ultimately insignificant trend. The meat behind a review in EDGE is what is written. Can't say that for a number of other review sources, but it IS the case for EDGE.

[QUOTE="ZIMdoom"]

I like how the conclusion of this article is that "EDGE scores can not be taken at face value." I don't take ANY review scores at face value. I think anyone who does follow review scores/grades isn't any more credible than the very people they are accusing of bias in the first place.

Anyone with a brain should READ THE REVIEW ARTICLES and then take the pros and cons of the game and think about how it would affect their own experience.

Espada12

This is nice and all to say but in reality we know alot of people just look at scores...

I don't care if everyone on earth does it...it is ridiculous and makes zero sense. I mean, who cares if Edge gives some PS3 game a lower score than other sites. This is the internet. If you care that much about scores, there are a million websites out there reviewing the exact same game. So why would anyone think EDGE is the authority?

Even in SW, what is the worst case scenario of EDGE being baised? Some fanboy saying to another faboy "Well, EDGE says that game sucks compared to 360"? My response would be, "So?"

[QUOTE="KingsMessenger"]

[QUOTE="Espada12"]

The data isn't flawed to be honest. It maybe a fanboy blog but doesn't make it any less true.

tok1879

It is inherently flawed given the scoring system employed by EDGE. Sometime as simple as the week that a game is scored could drop the scores from EDGE because they do not have a single scoring criteria beyond "Whatever you feel like giving it."

For all we know, Sony could send review copies to PS3 exclusives towards the end of the magazine cycle when the EDGE reviewers are under a lot more stress and would be more easily aggravated.

Also, all this proves is a correlation, not a causation. Until you can prove a causal link between the platform and the score, all you have here is an ultimately insignificant trend. The meat behind a review in EDGE is what is written. Can't say that for a number of other review sources, but it IS the case for EDGE.

LOGIC IS NOT MY FRIEND? Seriously, take a freaking science or statistics class.

"Since the 1950s, both the atmospheric CO2 level and crime levels have increased sharply.

Hence, atmospheric CO2 causes crime."

How is that logical? That is EXACTLY what the blog is doing and exactly what the person I quoted was doing.

Just because two data sets have correlating trends does NOT mean that they are linked.

The data in the article is correct, yes, but data is still just data. Honestly, I think it's just a coincidence. Edge have praised Ps3 plenty, not just in the review section either.angelkimne

Thank you, someone else who knows the difference between correlation and causation.

the part i immediately disagree with is when he compares a site's scores to metacritic averages

particularly because using averages negates whether Edge is clearly unique in their scoring or not, ie: if Edge and 10 other websites feel X game sucks, but 20 websites feel X game rocks their socks off, the average will end up looking bad for Edge

i also think it's a disservice towards the value of personal opinion, since an average of genuinely made-up scores (since very few websites use any kind of mathematical/scientific method for scoring) can vary from site to site just simply based on who it is doing the judging, a score is always simply attached as a "generalization" of a review, but it's always the content of a review that matters more

88mphSlayer

[QUOTE="88mphSlayer"]

the part i immediately disagree with is when he compares a site's scores to metacritic averages

particularly because using averages negates whether Edge is clearly unique in their scoring or not, ie: if Edge and 10 other websites feel X game sucks, but 20 websites feel X game rocks their socks off, the average will end up looking bad for Edge

i also think it's a disservice towards the value of personal opinion, since an average of genuinely made-up scores (since very few websites use any kind of mathematical/scientific method for scoring) can vary from site to site just simply based on who it is doing the judging, a score is always simply attached as a "generalization" of a review, but it's always the content of a review that matters more

tok1879

yet again... there are too many other variables for him to make a statement like "EDGE is biased against the PS3."

When he figures out how to isolate all the other factors, THEN he will have an argument. Until then, he just has a mountain of useless, insignificant data.

[QUOTE="KingsMessenger"]

[QUOTE="tok1879"] I don't think logic is your friend. On topic. I'm trying to find a hole in his presentation even though i pretty much agree with it, but i can't seem to find any. Can anyone come up with any suggestions? Something that doesn't have to do with what week of the month certain game exclusives are being reviewed.tok1879

LOGIC IS NOT MY FRIEND? Seriously, take a freaking science or statistics class.

"Since the 1950s, both the atmospheric CO2 level and crime levels have increased sharply.

Hence, atmospheric CO2 causes crime."

How is that logical? That is EXACTLY what the blog is doing and exactly what the person I quoted was doing.

Just because two data sets have correlating trends does NOT mean that they are linked.

Please explain what is wrong with my statements? Honestly? I am just dying to hear what you have to say.

[QUOTE="tok1879"][QUOTE="88mphSlayer"]

the part i immediately disagree with is when he compares a site's scores to metacritic averages

particularly because using averages negates whether Edge is clearly unique in their scoring or not, ie: if Edge and 10 other websites feel X game sucks, but 20 websites feel X game rocks their socks off, the average will end up looking bad for Edge

i also think it's a disservice towards the value of personal opinion, since an average of genuinely made-up scores (since very few websites use any kind of mathematical/scientific method for scoring) can vary from site to site just simply based on who it is doing the judging, a score is always simply attached as a "generalization" of a review, but it's always the content of a review that matters more

KingsMessenger

yet again... there are too many other variables for him to make a statement like "EDGE is biased against the PS3."

When he figures out how to isolate all the other factors, THEN he will have an argument. Until then, he just has a mountain of useless, insignificant data.