How Not to Compare the Xbox One and PS4

Oh man. Everybody, the Xbox One and Playstation 4 consoles are launching within a matter of days, at least where I live. But like most people who don’t string their hammocks up between two money trees, I can really only afford to buy one this year.

But which one? I know that I myself tried to prepare for this decision by listing the features of each console in two columns: one titled “Reasons to buy a PS4” and the other “Reasons to buy an Xbone.”1 Maybe you’ve done something similar, even if you’ve got a column on there for “Buy new PC instead, you console babies.”

bulleted list

But there are pitfalls to this kind of approach, because it makes us susceptible to certain biases and errors in logic. I thought it would be interesting to highlight a couple to help you make your last minute deliberations.

One: The Justification Effect

Let’s start with a simple thought exercise. Think of five types of chips.2 Any kind of chips –potato chips, corn chips, tortilla chips, whatever. Now, rank order those chips in terms of your preference. Done? Great. NOW, turn to the person on your left and explain your rankings. Tell this probably bewildered person why you put Doritos above Pringles and Ruffles above Fritos or whatever.

Congratulations, you’ve probably just fallen prey to the kind of error in judgement in thinking that may reduce the quality of your your decision about which console to buy.

Researchers Timothy Wilson and Jonathan Schooler were interested in whether or not this kind of introspection and explanation process could affect the quality of decisions people make when choosing among various alternatives.3 They gave subjects five different kinds of jam, asked them to taste each one, and then had them rank them. The researchers then compared those rankings with objective ratings of quality from a Consumer Reports study where professional food tasters ranked the same foodstuffs.

Wilson and Schooler had half their subjects explain their jam rankings in great detail, and those people went on about things like aroma, spreadability, and chunkiness. But compared to a control group that just ranked the jams without being forced to think too much about it, those in the “explain yourself” group made ratings that were further off from the professional tasters at Consumer Reports. They were, the researchers argued, less accurate ratings.

xbo system

Why? Because the subjects started focusing on factors that didn’t really matter. Smucker’s had more chunks of fruit in it, so it gets a higher rating. Wait, what? Is chunkiness really important for jam? Doesn’t matter; it sounds plausible so it got factored in.

And that’s the key point: when asked to think about and justify our preferences, we kick off a search for possible reasons that are both salient (that is, obvious) and easy to communicate. The fact that some of these reasons might not make sense for us in our particular circumstances can get shoved to the sidelines if it makes it easier to explain our otherwise unexplainable preferences. Thus those of us pondering which console to buy and trying to lengthen that that two-column list may put “Remote play with PS Vita” down in the PS4’s favor even though we don’t own a PS Vita and don’t think we’ll ever buy one. Or maybe you’ll put down “Gamerscore ports over” under the “Reasons to Buy an Xbone” column even though just five minutes before starting the process you’d have said you don’t care at all about gamerscores.

Why? Because those are salient and easy to communicate reasons that make your introspection and justification tasks easier, even though they won’t improve the quality of your decision.4 How do you combat this? Think carefully about everything you put on that list in terms of whether it’s really a benefit to you or not, then strike it if not. For myself, I mitigated this potential error by weighting each console feature as a big, medium, or small reason to buy. This let me keep them on the list, but also let me compare options more realistically.

Two: The Misuse of Missing Information Effect

Most of the decisions we make involve some amount of uncertainty, and backing a player in the console wars is no exception. We don’t always have certain information available, or if it is out there we have to go through some effort to track it down. But be careful, because we tend to pursue and overvalue information that really should be useless to us –just because we went to the trouble of getting it.

Researchers Anthony Bastardi and Eldar Shafir were interested in how decision-makers would value information that they had to wait to get.5 In a series of experiments they had people pretend to be in various roles such as a college admissions officer, a student registering for a class, a bank loan officer, or just an average Joe shopping for some new electronics. Half of the subjects –the ones in the control group– were given a complete set of information to make their decision. For example, in one study they read this:

Imagine that you are on the admissions committee of Princeton University. You are reviewing the file of an applicant who plays varsity soccer, has supportive letters of recommendation, and is editor of the school newspaper. The applicant has a combined SAT score of 1250 and a high school average of B. Do you…

a) accept the applicant?
b) reject the applicant?

The other half of the subjects, though, were in the “uncertainty condition.” They had most of the same info, but with this difference at the end:

You have two conflicting reports of the applicant’s high school average grade. The guidance counselor’s report indicates a B average, while the school office reported an A average. The school has notified you that the records are being checked, and that you will be informed within a few days which of the averages is the correct one. Do you…

a) accept the applicant?
b) reject the applicant?
c) wait for clarification from the applicant’s school before deciding?

Unsurprisingly, most study participants opted to wait for clarification and it turned out that the average grade was a B. This made the candidate’s profile identical to the one that those in the control group, except that subjects in the uncertainty condition had to imagine waiting a few days to get one missing piece.

What happened? Some of those in the uncertainty condition ended up putting more weight on the average grade data point, and the group rejected the candidate about 10% more often as a result. Across several other experiments the researchers found evidence that when information is missing and then made available, we put more emphasis on it while making decisions. You think “Hell, I went through the trouble of getting this information, I’d better use it.” And in doing so, we calibrate wrongly and overvalue it.

So don’t do this with the new consoles. Say that after hearing the news about how the PS4 won’t act as a DLNA server and won’t play or stream music from your network, you wonder if the Xbone will. That information isn’t readily available, so you have to wait for the information to come out a few days later in a FAQ from Microsoft or from reviews in the press. You’re might very well overvalue that feature in your decision.

ps4 console - Copy

Or let’s take another example. Imagine that the cross-platform Call of Duty: Ghosts is on your must-buy list, so you’ll be getting it on whatever console you guy. But the reviews on the Xbone version of that game are under embargo for a week longer than those for the PS4.6 When the PS4 reviewer mentions frame rate dips, you wonder if that’s as big a problem on the Xbone but you can’t find out. You have to wait a week for that version’s reviews to come out, and as a result you may overvalue frame rate as a criteria against which to judge that version of the game and the console, relative to other factors.

So be careful when you have to wait for or work for information. Think about each piece individually and either discard it if it’s irrelevant or weight it appropriately. Or, better yet, wait until most of the information is available –such as after launch and after press embargoes– before putting on your thinking cap.

So there you have it: common errors in judgement that may specifically arise because you made bulleted lists comparing the new consoles from Sony and Microsoft. It’s good that we think carefully and base our decisions on hard data, but brains don’t always work how we expect them to.

That said, though, I have to ask: which are you going to buy? Or, if you are from the future, which did you buy? And how did you make that decision?


1. And yes, that’s the abbreviation for the Xbox One that I believe the world has settled on.
2. Or “crisps” if you’re from certain parts of the tea sipping, pram pushing world. Or you know what? Fine. Think of five kinds of french fries. It still works.
3. Wilson, T. & Schooler, J. (1991). Thinking Too Much: Introspection Can Reduce the Qualities of Preference and Decisions. Journal of Personality and Social Psychology, 60(2), 181-192.
4. And yes, I realize that some of you do own Vitas and love your Gamerscore. I’m just taking those as possible examples.
5. Bastardi, Anthony, and Eldar Shafir. “On The Pursuit And Misuse Of Useless Information..” Journal of Personality and Social Psychology 75.1 (1998): 19-32.
6. This did, in fact, happen. PS4 reviews of CoD:G were available for a week while Xbone ones were still under embargo.

15 thoughts on “How Not to Compare the Xbox One and PS4

  1. I won’t be getting either–I’m a PC guy–but I can definitely recommend the Heath brothers’ book _Decisive_ as a help to making such decisions.

  2. Also a PC guy. After the debacle of the PS4 in my country (that costs the amazing amount of $1800 after taxes), overhauled completely my PC for way less money. Now I’m sure it will truck on for another 5 or 6 years, for way, way cheaper games

  3. Really interesting, I’m leaning towards the Xbox and probably for some pretty arbitrary reasons. I already own the 360 so there’s some weird brand loyalty factor and I quite like the controller. If you look at it they are very very similar machines and will have almost the same line up of games just like the current generation so liking one more than the other might not make much sense…but just like coke and pepsi we tend to form strong opinions and our own biases give us very different perceptions and experiences of both products.

  4. I’m getting the Xbox One, because I prefer the controller and interface. It’s just a matter of opinion. No console is definitively better than the other. However, my girlfriend got a PS4 that I get to play exclusives on, so I’m pretty happy.

  5. I won’t be buying either. Not because I’m a “PC guy”; I am still playing games on my Xbox 360 and there are no convincing reasons for me to part with more cash to get an Xbone. I haven’t even considered the PS4 because I already have a console. It’s a bit like tea kettles – I have a tea kettle. Why would I want another one? Maybe when it breaks or when there are convincing reasons to get a new one, sure. But right now? No need. I’m saving my money, thanks.

  6. I will avoid psfour and xbox one for a simple good reason,these companies always have major bugs for the first few years,there is already a massive issue with xbox one,allot of the systems are having a won’t read disc issue then admitting a sound like a creditcard going through the paper shredder.I know there is bugs with the ps four already. If I was going to buy any of the systems when their new it would be wiiU simply because nintedo does a ton of system checks quality checks and durability tests with their systems unlike the other two.

    • There are supposedly fewer PS4 broken than PS3 at PS3 launch. The thing is that people with broken consoles are vocal about it and the one who don’t, aren’t. So your perception of the problems might be exaggerated.

  7. I will keep my PC of course. Last console I owned was a NES and right now is certainly not the right time to get back into consoles.

  8. I am currently tossing up between building a new small form-factor gaming rig for the living room or buying a PS4. The PC is a more tempting idea, particularly because I like the idea of designing a solid ITX gaming machine, but it’s also triple the price.

    I want to know which the author ended up going with

  9. I ended up getting an Xbox One. It had an exclusive title I wanted to play (Dead Rising 3) and the Kinect stuff felt like future tech –something new that I hadn’t had before. I’m pretty happy with the choice.

    Coincidentally about the same time I had a guy run an HDMI cable through the walls from my office to the TV. Along with a 16-foot USB cable for a controller, this lets me do the PC games on TV thing. So I’m all set!

  10. “Gamerscore ports over” as a exclusive to the xbox 1 is incorrect, the PSN has levels (im level 13 last i checked) and it tally’s all PSN trophy compatible platforms [ps3&4, and PS Vita]) which are equivalent to the gamerscore

  11. Jamie, are you looking for a test subject or for some scientific material? Because, HERE I AM.

    I’ve bought PS4 the next day after the launch (been working on the launch day). Had it for about 5 months, finished Knack, played a bit of Killzone, NFS, got Tomb Raider but never opened it. Sold all of it.

    Then, I re-bought it this month. Somehow, it makes sense to me to have PS4 now, as it looks like it gets more and more games.

    Also, all those new games that are multiplatform, look like shit on my XB360, when compared to PS4. And, they are priced the same. So if I’m going to pay the same price, I’d rather have a game for a new console, that looks better (and perhaps this is the psychology behind pricing games like “LEGO Marvel” or “NFS Rivals” for XB360 and PS4).

    Why I’m not getting XBONE? PS4 seems to be a gaming console first. Yes, they will add some more functions later. XBONE? I heard MS tried to make developers use DirectX API. I heard it runs a hypervisor and 2 operating systems (one for games, second for the UI). Yes, I realize ,that this seems to be a modern pattern today (WiiU has 2 CPUs, for the same reasons), but if you make a gaming console and your own software seems to be a obstacle for making games on it, well, you do have a problem.

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.