Metacritic: 2012 Lacked Quality Games

Flatfrog

New member
Dec 29, 2010
885
0
0
Interesting how people are tending to be quite negative about this news. It sounds pretty reasonable to me; yes, there were some truly great games this year, and psychologically our memory of those (combined with the fact that we tend to remember more recent things more vividly) means that we find it difficult to believe this kind of statistic. But this isn't about the few excellent games, this is about the overall picture, and certainly when I look back on the 2011 best-of lists it was notable how many more games came up on them.
 

Jezzascmezza

New member
Aug 18, 2009
2,500
0
0
It certainly wasn't a bad year for gaming though.
Nevertheless, maybe reviewers are becoming a little bit more harsh simply because their frustrated by the lack of truly new games- I know there were a number of fresh experiences throughout the year, but the games industry really isn't going to get a proper shake-up until some new consoles get released...
 

cidbahamut

New member
Mar 1, 2010
235
0
0
Metacritic is only relevant because gaming media refuses to shut the fuck up about it. It aggregates review scores and all those review scores operate on different scales by virtue of being from different people. It doesn't really amount to much of anything beyond a lot of people heaping far more attention on it than it deserves.

The sooner people get over it and accept it as nothing more than a collection of data points the better.
 

Zeriah

New member
Mar 26, 2009
359
0
0
Definitely true I think. I spent all of 2011 frantically trying to find funds for all the amazing games. I spent most of 2012 buying the games I missed in 2011. Even discounting the scores and just comparing the lists, there's a really noticeable difference in my opinion.

There's been worse years though and it is kind of unfair to compare it to 2011, which was just a spectacular year (best since 2007 at least in my mind).
 

Tortilla the Hun

Decidedly on the Fence
May 7, 2011
2,244
0
0
Idunno what to make of these scores, but rather than take the views of the reviewers and apply them to my own filter, I'm just going to accept them for what they are: other people's (perhaps professional, but perhaps not) views of how well a game performed. I, on for one, enjoyed many of the games that were released last year, and I'm still enjoying last year's games. Not just what few indies I've purchased, but also many of the year's "biggest" AAA titles. Overall, I think it was a fantastic year for games and, with what's expected to be released this year, I've little doubt it has anywhere to go but up.
 

rembrandtqeinstein

New member
Sep 4, 2009
2,173
0
0
2012 was awesome, this just proves metacritic is bollox

some of the ones I considered to be really good:

legend of grimrock
binding of isaac: wrath of the lamb
spec ops: the line
walking dead
guild wars 2
mark of the ninja
borderlands 2 (my game of the year)
torchlight 2
dishonored
xcom
giana sisters
halo 4
angry bids star wars
far cry 3

So yes this year was backloaded with lots of stuff dropping in 4th quarter but that doesn't mean there wasn't lots of great stuff.

Oh and also a big updates to Dwarf Fortress...so yeah metacritic is losing its relevancy
 

Fappy

\[T]/
Jan 4, 2010
12,010
0
41
Country
United States
I suppose it's possible that the average score is declining because reviewers finally understand that when you rate a game x/10 the potential scores include all numbers between 1 and 10... not just 7, 8, 9 and 10 >.>
 

DustyDrB

Made of ticky tacky
Jan 19, 2010
8,365
3
43
Eh, it's my favorite year for gaming. But whatever. "Other people" and "different opinions" and whatnot.
 

geizr

New member
Oct 9, 2008
850
0
0
Executive summary: I believe the low scores may be because there is a shift to give the 0-10 scale proper meaning so that 5/10 means "average game" rather than 8/10 meaning "average game".

Now, on to the wall-of-text.

Funny to run across this article today. My friend and I, just last night, were discussing game review ratings inflation over a meal at Red Robin. We both came to the consensus that if the 0-10 scale is being properly used, then most games, at any given point in the history of the game industry, should fall in the mid 4 to high 6 range of scores. The reason is that this range, no matter the context, criteria, and time period, should always correspond to an average game. This is a game that hits all the basics, doesn't really do anything wrong, but doesn't do anything spectacular or revolutionary either. These are games that simply make par. Once you get into the range of 7's, you start talking about good games that maybe do some interesting stuff. At 8, the games become extraordinary works that have a high level of quality and polish. At the range of 9 and beyond, these are games that are works of genius and pure masterpieces. These would be the kind of games that reinvent the genre or completely change the rules of how games of that type (or, sometimes, any game) are designed and made. These are truly wonder works.

Now here's the problem. Once the concepts, techniques, and ideas of the 8, 9, and even 10 rating games becomes common or expected, any game thereafter can only garner a score, once again, in the mid 4 to high 6 range, possibly even low to mid 7's if enough polish is put into it. This is because the spectacular becomes ordinary (or mediocre) once it becomes common enough and easily reproducible through minimal effort. It becomes the norm. Consider the fact that many of the elements in games today that we take for granted, just 10-15 years ago required incredible effort and truly extraordinary, out-of-the-box creative thinking to accomplish. Nowadays, much of the effort to produce those same elements is a matter of calling some function built-in to the hardware or the packaged game-engine. It's a mundane effort to create those same elements now. It just doesn't astound us or fill us with awe and wonder anymore. It's expected and ordinary; thus, it gets a score hovering in the mediocre range of mid 4s to mid 6s, maybe low to mid 7s, depending on the amount of extra polish put into the game.

At the heart of it all is a disconnect with reality. We're expecting games to be mind-blowing at every single iteration, and that's just not possible. We are constantly needing a bigger and bigger "rush" for each successive game to satisfy us (it has to be more potent each time). Unfortunately, game quality, like so other things, likely follows a Bell curve. Most games, no matter the context or time period, are going to fall into the average range, scores of 4.5 to 6.5. As you go outside that range, in both directions of decreasing quality and increasing quality, you get a rapid, monotonic decrease in the population of games at those scores. If we are always expecting most games to be well-beyond average in quality, i.e. beyond what is considered the norm, then we are only setting ourselves up for disappointment each time.

Even further to this point, we also need to consider that much has been made of the visible score inflation that has been going on in years prior, such that an 8/10 score is considered "average". This kind of skewing, once corrected, will make it appear as if games are of lower quality than prior years if we are still holding to the notion that 8/10 is for an average game, as opposed to a more proper 5/10 rating. The games are likely no better or worse, in context, than at any other time; however, our perceptions have been distorted by long-standing abuse of the scoring scale to give the appearance that every game is of exceptional quality, i.e. worthy of 8/10, when, in fact, the game is only of contextually average quality. This is what leads to the phenomenon of "8 out of 10" becoming "Hate out of 10", as Jim Sterling coined the term. We can see that the games are only of contextually average quality, so we mentally equate 8/10 to "average" or mediocre, even though the scale says that 8/10 is supposed to be exceptional. We still try to use 8/10 as meaning exceptional, but we know this is not really the case by observation of the population distribution. Thus, the meaning of the scale has been disconnected from reality.

I would posit that the phenomenon we are seeing here with these scores is a long overdue correction in which the meaning of the 0-10 is properly aligned with reality such the 4.5-6.5 range means "average", in context, and scores of 8.0 and above are the truly exceptional games. Because the population distribution can be expected to follow something similar to a Bell curve, we should see the vast majority of games occupy scores in the 4.5-6.5 range, with progressively fewer games scoring outside that range, higher or lower. This could make the appearance of games being worse, if we hold to our prior distortion of 8/10 being an average score, when they are, in fact, contextually unchanged in quality.

EDIT: Decided saying "For the TL;DR" sounds to insulting. Changed it to be what it really is, an executive summary.

ADDENDUM: I have commented in prior posts my disagreement with the level of precision that reviewers attempt to assign to game-review scores. In my opinion, a 1 in 100 or better precision is just not possible with a qualitative heuristic like reviewing a game. There simply is no scientific standard criteria or mathematical algorithm, in my opinion, being used universally for reviewing games that could allow such a high precision in the scoring process, even with averaging of multiple scores from multiple reviewers. At best, one can only meaningfully attain a 1 in 10 precision, and even degrading to a 1 in 5 precision is often sufficient to convey qualitative meaning to the score. In my opinion, the qualitative nature of these scores just doesn't lend credence to using such high precision in the numerical value.
 

Scow2

New member
Aug 3, 2009
801
0
0
Madkipz said:
This is the year of the indies after all. Guess what games they don`t feature on metacritic? LOOLLLLLL
Yes they do.
geizr said:
Executive summary: I believe the low scores may be because there is a shift to give the 0-10 scale proper meaning so that 5/10 means "average game" rather than 8/10 meaning "average game".

Now, on to the wall-of-text.

Funny to run across this article today. My friend and I, just last night, were discussing game review ratings inflation over a meal at Red Robin. We both came to the consensus that if the 0-10 scale is being properly used, then most games, at any given point in the history of the game industry, should fall in the mid 4 to high 6 range of scores. The reason is that this range, no matter the context, criteria, and time period, should always correspond to an average game. This is a game that hits all the basics, doesn't really do anything wrong, but doesn't do anything spectacular or revolutionary either. These are games that simply make par. Once you get into the range of 7's, you start talking about good games that maybe do some interesting stuff. At 8, the games become extraordinary works that have a high level of quality and polish. At the range of 9 and beyond, these are games that are works of genius and pure masterpieces. These would be the kind of games that reinvent the genre or completely change the rules of how games of that type (or, sometimes, any game) are designed and made. These are truly wonder works.

Now here's the problem. Once the concepts, techniques, and ideas of the 8, 9, and even 10 rating games becomes common or expected, any game thereafter can only garner a score, once again, in the mid 4 to high 6 range, possibly even low to mid 7's if enough polish is put into it. This is because the spectacular becomes ordinary (or mediocre) once it becomes common enough and easily reproducible through minimal effort. It becomes the norm. Consider the fact that many of the elements in games today that we take for granted, just 10-15 years ago required incredible effort and truly extraordinary, out-of-the-box creative thinking to accomplish. Nowadays, much of the effort to produce those same elements is a matter of calling some function built-in to the hardware or the packaged game-engine. It's a mundane effort to create those same elements now. It just doesn't astound us or fill us with awe and wonder anymore. It's expected and ordinary; thus, it gets a score hovering in the mediocre range of mid 4s to mid 6s, maybe low to mid 7s, depending on the amount of extra polish put into the game.

At the heart of it all is a disconnect with reality. We're expecting games to be mind-blowing at every single iteration, and that's just not possible. We are constantly needing a bigger and bigger "rush" for each successive game to satisfy us (it has to be more potent each time). Unfortunately, game quality, like so other things, likely follows a Bell curve. Most games, no matter the context or time period, are going to fall into the average range, scores of 4.5 to 6.5. As you go outside that range, in both directions of decreasing quality and increasing quality, you get a rapid, monotonic decrease in the population of games at those scores. If we are always expecting most games to be well-beyond average in quality, i.e. beyond what is considered the norm, then we are only setting ourselves up for disappointment each time.

Even further to this point, we also need to consider that much has been made of the visible score inflation that has been going on in years prior, such that an 8/10 score is considered "average". This kind of skewing, once corrected, will make it appear as if games are of lower quality than prior years if we are still holding to the notion that 8/10 is for an average game, as opposed to a more proper 5/10 rating. The games are likely no better or worse, in context, than at any other time; however, our perceptions have been distorted by long-standing abuse of the scoring scale to give the appearance that every game is of exceptional quality, i.e. worthy of 8/10, when, in fact, the game is only of contextually average quality. This is what leads to the phenomenon of "8 out of 10" becoming "Hate out of 10", as Jim Sterling coined the term. We can see that the games are only of contextually average quality, so we mentally equate 8/10 to "average" or mediocre, even though the scale says that 8/10 is supposed to be exceptional. We still try to use 8/10 as meaning exceptional, but we know this is not really the case by observation of the population distribution. Thus, the meaning of the scale has been disconnected from reality.

I would posit that the phenomenon we are seeing here with these scores is a long overdue correction in which the meaning of the 0-10 is properly aligned with reality such the 4.5-6.5 range means "average", in context, and scores of 8.0 and above are the truly exceptional games. Because the population distribution can be expected to follow something similar to a Bell curve, we should see the vast majority of games occupy scores in the 4.5-6.5 range, with progressively fewer games scoring outside that range, higher or lower. This could make the appearance of games being worse, if we hold to our prior distortion of 8/10 being an average score, when they are, in fact, contextually unchanged in quality.

EDIT: Decided saying "For the TL;DR" sounds to insulting. Changed it to be what it really is, an executive summary.
Actually, "Average" for a game IS, and always HAS BEEN, around 7, not 5. And the reason is developers like Sergy Titov. Before assigning a review score, the reviewer must ask, "Is this game SO BAD that it deserves to be ranked within 4 points of Big Rigs Over The Road Racing or The War Z?" And the answer is always "NO!"

Most games get high ratings because the ones unworthy of high ratings don't reviewed, but still stick around in the reviewer's consciousness. And because there are SO MANY ways a game can go wrong, it's better to have the 1-5 scale around to indicate JUST HOW BADLY a game screws up. 1's are reserved almost exclusively for spectacular failures - which sane people are smart enough to not ever actually release.
 

geizr

New member
Oct 9, 2008
850
0
0
Scow2 said:
Actually, "Average" for a game IS, and always HAS BEEN, around 7, not 5.
No, that is not true. A bit more than 20 years ago, because I can remember checking out game scores in the magazines (yes, I'm that old), a score of 5/10 WAS considered average. A game getting an 8/10 score really was usually extremely exceptional. I've actually watched the score inflation happen as time has progressed.
 

AlwaysPractical

New member
Oct 7, 2011
209
0
0
I think the reason for this, more than anything else is that more and more sites and reviewers are moving towards a 5 as an "average" rating. It's not low quality, it's score deflation, which I think is a very good thing.
 

medv4380

The Crazy One
Feb 26, 2010
672
4
23
Timothy Chang said:
"In fact, since we started publishing these year-end reports in 2009, we have never encountered such a low total number of great games in a single year." That's not much historical data to go on, but the marked drop in high-scoring games is noteworthy.
Oh, come on. Bad reporting and bad analysis.

Don't bother looking at N's or Counts. They are deceptive.
Sum up the counts for 2010 to 2012 for each system.
By their Measure
2010 2.78% Great games
2011 3.95% Great games
2012 2.80% Great games

Basically, 2011 was a good year for great games., and 2012 just reverted back to Normal.
So what happened? Why is the N so small.
Easy

2010 - 647 Games
2011 - 583 Games
2012 - 500 Games

If you remove Nintendo
2010 - 491 Games
2011 - 514 Games
2012 - 447 Games

I'm not even taking into account the margin of error these number should have. But the conclusion is clear. Game development Dropped off a cliff between 2011 and 2012. Game development is only at 86% of 2011 with or without Nintendo's Wii. Saying that this affected great games is like saying Catching a Flu will Give me a Fever. Fewer Great games is a symptom of having fewer games made.
 

Vhite

New member
Aug 17, 2009
1,980
0
0
7/10 not good enough for you eh?

Im really starting to hate metacritic lately. Most of ratings there are based on first 5 minutes of impression of them game. I would rather be limited to 7/10 - 10/10 ranking of bribed journalists than to take anything from a rating that was created by people who could not be bothere to download 1 MB patch.
 

Ickorus

New member
Mar 9, 2009
2,887
0
0
In the last year I have noticed two things:

Users repeatedly 'bombing' reviews because of the most inconsequential bullshit.
Reviewers repeatedly giving good games low scores to put their shitty websites on the map.
 

Gregg Lonsdale

New member
Jan 14, 2011
184
0
0
I really don't like metacritic and I never take their review scores into account when deciding on a purchase, but they're pretty much right here. I mean, there was Spec Ops as the standout in my mind, Far Cry 3 looks pretty good (watched a friend play it for a while) and ME3 and Dishonored were reasonably okay (as were Borderlands 2 and Max Payne 3 to a lesser extent). And I can't even think of anything else that is worth getting worked up over.

At least this year looks like it might be better (assuming we all look the other way when Dead Space 3 nose-dives onto the tarmac in brightly-lit explosion of random viscera). I'm cautiously optimistic about Bioshock, Amnesia and Metro, though I find it sad that the games I'm looking forward to most are all part of established franchises (though at least not direct sequels. Baby steps here)