The Psychology of Immersion

By far, one of the most widely linked to and discussed articles I’ve written for this site is this one on immersion in video games. A while back I wrote an expanded version of that article for GamePro magazine where I focused more on new video game technologies, and GamePro.com has recently published it for your reading pleasure. Oddly, they put it up as a 25 meg pdf file. I’m …not sure why. But you can download it and see the whole thing for yourself, including nifty sidebars and artwork like this:

If this happens to you, do not panic. Perfectly normal.

Bobo the Quote Monkey was happy to have the work, so he sat through the download and fetched this quote:

The game world also needs to behave as you’d expect it to. “Consistency is the single most important factor in creating a real sense of place,” says Josh Foreman, an experienced designer at ArenaNet who works on the Guild Wars games. “The style can be anything from photo-real to abstract to impressionism, as long as there is an internal logic to what the player perceives.” This means that in-game characters, objects, and other aspects of the world should behave like their real-world counterparts.

…Interestingly, research is incomplete in this area, as it seems we’ll readily ignore some incongruous elements. Even the most engrossing movie is full of artificial jumps in time and cuts to different points of view, but we take these in stride. One researcher looked at what effects subtitles in foreign-language films had on creating presence and found that these words floating conspicuously in space beneath the movie’s characters were such an accepted convention that they didn’t hinder a feeling of presence. Likewise, players accept heads-up displays or damage indicators in video games with little damage to presence.

This article is different than the other GamePro pieces I’d written to date. I played around with the idea of introducing the article with a non sequiter ((Wait, can you START something with a non sequiter? I hope so, because I guess did.)) by talking about Cinerama. For those of you who aren’t movie historians, Cinerama was an early technology aimed at making movies more immersive, and I saw some interesting parallels between that and our modern day wide-screen TVs, surround sound, and motion controls. I think it kind of worked, and it’s an approach that I’m going to try to use more often when I have the space to do it.

Special thanks to Paul Harvey, Dr. Paul Skalski at Cleveland State University and Josh Forman from ArenaNet for providing input on the article. If you’re interested, the current print issue of GamePro on shelves now (the one with Twisted Metal on the cover) has a fun article on the psychology of loot drops. It involves monkeys!

Motion Controls and Presence

Does motion control help us feel like we’re “in” a game’s world?

A few weeks ago I published an article on presence and video games, discussing a model of what puts us in the curious psychological state of feeling like we’re in a game world. When we experience presence we ignore the technology between us and that world, and we’re more likely to enjoy the game and more quickly able to learn its rules. I hypothesized at the time that motion controls that more closely mimic real movements are more likely to create presence, but that the research still had some ground to cover. I continued to read about the topic and given the recent release of Playstation Move and the imminent release of Kinect for the Xbox 360 I thought it would be a good time to revisit the relationship between motion control and presence. Topical!

Playstation Moves

Move! Move! Move! Move!

Besides the fact that absent or extremely simplified controls give us a lot less technology to forget about on our way to presence in the first place, the other reason to think that motion controlled games can create more presence has to do with mental models. In the context of video games, mental models are the representations we build of a game world –how the space is arranged, what its characteristics are, what the hell that thing is, what’s the deal with all the screaming when I press this lever, and so forth. One could hypothesize that more natural game controls help players more easily build and access those mental models by allowing us to take information from the real world (“I’m swinging a bat!”) and immediately understand what that action means for things in the game (“My little dude is swinging a bat in the same way!”). This creates consistency between things ((“Things” is a technical term you can never over use. Go on, just try to over use it. You can’t!)) in game and what we know about their real life counterparts –and that’s just the kind of thing that has been shown to create presence.

Paul Skalski at Cleveland State University and several collaborators decided to put idea this to a test and published their results earlier this year in the journal New Media & Society. ((Skalski, P., Tamborini, R., Shelton, A., Buncher, M. & Lindmark, P. (2010). Mapping the road to fun: natural video game controllers, presence, and game enjoyment. New Media & Society.)) They were interested in how “naturally” a controller was used to play a game and what effect that had on presence and enjoyment. To kick things off, they proposed an interesting typology of natural control mapping. ((Big thanks, by the way, to Paul Skalski for talking to me about his research and forwarding me this paper.))

Directional natural mappings are the least natural, represenging simple up/down/left/right mappings and maybe some buttons. Think Street Fighter 4: up to jump, left/right to move, down to crouch, and buttons to punch or kick.

Kinesic natural mappings are those that involve gross body movements ((Pun intended? Yes, pun intended.)) to control the game without holding a controller. This is pretty much every Kinect game, plus some of Sony’s EyeToy games.

Incomplete tangible natural mapping gives players something that feels like an in-game object. Wii Sports, for example, uses this kind of mapping when it asks you to use the wiimote like a tennis racket or golf club. A lot of Playstation Move controls are going to fit in here, too, like the ping pong game or the archery game in Sports Champions.

Realistic tangible natural mapping, though, is the most realistic kind of controller. This gives you a thing that is a thing and behaves like the thing in the game …thing. ((I’m telling you, can’t be over used!)) Steering wheels for racing games fall into this category, as do drum sets for Rock Band or Guitar Hero –not to mention that nutso stringed guitar controller that Mad Catz wants you to buy for Rock Band 3.

(As a side note, I actually think this typology is deficient because it lacks a place for motion-tracked controllers that are used in ways that are not asking you to mimic holding something specific. Wiggling the wiimote to make Mario spin in Super Mario Galaxy or aiming it at the TV to make Samus fire rockets in Metroid: Other M doesn’t fit in anywhere here, but those kind of controls certainly exist.)

Flailing around like a nincompoop really makes me feel like I'm flailing around like a nincompoop IN THE GAME!

Skalski et al. were interested in whether more natural mapping of controls would lead to greater self-reports of presence while playing games, so they ran two experiments. In the first, they had one group play Tiger Woods PGA Tour 07 on the Nintendo Wii using the wiimote like, appropriately enough, a golf club. Another group played the Playstation 2 version of that same game using the dual shock controller. The results were that the wiimote did indeed feel more natural, as measured by questions like “The actions used to interact with the game environment were similar to the actions that would be used to do the same thing in the real world.” No surprise there, but they also found that use of such controls did correlate with spatial presence (“To what extent did you experience a sense of ‘being there’ inside the environment?”) and people who played the game on the Wii were more likely to report experiencing presence than those who played with the PS2 controller.

The researchers then decided to kick it up a notch and compare several different types of controllers on the same game. They had participants play the racing game Need for Speed Underground 2 using a keyboard, a joystick, a gamepad, or a steering wheel. Same results: the steering wheel, which represented a “realistic tangible natural mapping” according tot he taxonomy above, was perceived as the most natural and players in that group were the most likely to report feeling like they were “in the game.”

This all suggests that if the goal of your game is to make players feel like they’re part of a game world, motion controllers are better than traditional game pads or keyboards. ((Though I should note that Skalski et al. never tested a “kinesic natural mapping” a la Microsoft’s Kinect or a pure EyeToy game. Someone should do that.)) Of course, not all games have presence as a design goal, not all games can be controlled with motion, (imagine trying to play Starcraft II with just motion control) and there are probably other characteristics of motion control (like exhausting or uncomfortable movements) that could detract from the overall enjoyment of a game. Again, this is an area rife with possibilities for research …things.

Anyway, has anyone played around with the Playstation Move yet? Does it make you more likely to forget that the game you’re playing is mediated by technology?