How Our Brains are Wired to Read

First published August 19, 2010 in Mediapost’s Search Insider

How do we read? How do we take the arbitrary, human-made code that is the written word and translate it into thoughts and images that mean something to our brain, an organ that had its basic wiring designed thousands of generations before the appearance of the first written word? What is going on in your skull right now as your eyes scan the black squiggly lines that make up this column?

The Reading Short Cut

I’m currently reading Nicholas Carr’s “The Shallows: What the Internet is Doing to Our Brains,” a follow-up to Carr’s article in The Atlantic, “Is Google Making Us Stupid?” The concept Carr explores is fascinating to me: the impact of constant online usage on how the neural circuits of our brain are wired.

But there was one quote in particular, from Maryanne Wolf’s book, “Proust and the Squid: The Story and Science of the Reading Brain,” that literally leapt off the page for me: ‘The accomplished reader, Maryanne Wolf explains, develops specialized brain regions geared to the rapid deciphering of text. The areas are wired ‘to represent the important visual, phonological and semantic information and to retrieve this information at lightning speed.’ The visual cortex, for example, develops ‘a veritable collage’ of neuron assemblies dedicated to recognizing, in a matter of milliseconds, ‘visual images of letters, letter patterns and words.'”

For everyone reading this column today, that is one of the most relevant passages you may ever scan your eyes across. It’s vitally important to digital marketers and designers of online experiences. Humans that read a lot develop the ability to recognize word patterns instantly, without going through the tedious neural heavy lifting of translating the pattern through the language centers of the brain. A quick neurological tour is in order here.

How the Brain Reads

The brain has a habit of developing multiple paths to the same end goal. Many functions that our brain controls tend to have dual routes: a quick and dirty one that rips through the brain at lightning speed and a slower, more rational one. It’s the neural reality behind Malcolm Gladwell’s “Blink.” This dual speed processing is a tremendously efficient way of coping with our environment. The same mechanism, according to Wolf, has been adapted to our interpretation of the written word.

Humans have an evolved capacity for language. Noam Chomsky, Steven Pinker and others have shown convincingly that we come out of the box with inherent capabilities to communicate with each other. But those abilities, housed in the language centers of the brain (Wernicke’s and Broca’s Areas, if you’re interested) are limited to oral language. Written language hasn’t been around nearly long enough for evolution’s relatively slow timeline to have had much of an impact. That’s why we learn to speak naturally just by hanging around other humans, but only those with a formalized and structured education learn to read and write. We have to take the native machinery of the brain and force it to adapt to the required task by creating new neural paths.

Instantly Recognizable…

So, when we read a page of text, there’s a fairly complex and laborious process going on in our noggins. Our visual cortex scans the abstract code that is written language, feeds it to the language centers for translation, and then sends it to our prefrontal cortex and our long-term memory to be rendered into concepts that mean something to us. The word “horse” doesn’t really mean the large, hairy, four-legged mammal that we’re familiar with until it goes through this mental processing.

But, like anything that humans do often, we tend to create short cuts through repetition. It’s important to note that this isn’t evolution at work, it’s neuroplasticity. The ability to read and write is built in each human from scratch. The brain naturally tries to achieve maximum efficiency by taking things we do repeatedly and building little synaptic short cuts. Humans who read a lot become wired to recognize certain words just by their shape and appearance, without needing to run the full processing cycle. Your name is a good example. How often have you been reading a newspaper or book and run across your last name? Does it seem to “leap off the page?” That was your brain triggering one of its little short cuts.

So, what does this mean for online interactions, particularly with a search engine? In next week’s column, I’ll revisit a fascinating brain scanning study that was done by UCLA and take a peek at what might be happening under the hood when we launch a Web search.

 

The Human-Technology Connection: Enabling Change

First published May 6, 2010 in Mediapost’s Search Insider

Aaron Goldman scooped my column on Apple, Siri and search (although, looking at the column, I think I can claim partial authorship) so I’m going to broaden the lens a little bit. This is a theme I’ve discussed in a number of recent presentations, as well as at least one prior column, and I think it touches on why the news from Apple and Siri is potentially so important.

Humans Will Be Human

I’ve said before that “technology doesn’t cause our behaviors to change, it enables our behaviors to change.” The difference is subtle but profound. Let me give you an example.

I recently moderated a panel discussion on social media in the B2B marketplace. One by one, the panelists marched out their supporting evidence (14 zillion people access Facebook every 12 seconds, that sort of thing) and their own opinions. The consensus was: things have changed. Indeed, they have. But at the top of the session, I said this wasn’t about technology, this was about people. And people are social animals. We follow the herd, and more importantly, we communicate with the herd. One could feel the “Groundswell” (a pun and plug in one!) literally surging through the room.

At the end, we turned to the audience for Q&A. A middle-aged woman, definitely falling on the Digital Immigrant side of the tech-savvy divide, stood up and called the entire panel out: “I don’t buy it. I don’t buy all this technology is making us more connected. I haven’t seen any evidence of it. In fact, I’ve seen the opposite. I’m a professional recruiter and I can’t get a candidate to pick up the phone and talk to me. I need to get to know them and I can’t do that through an email. I need to have a conversation. I think technology is isolating us, not connecting us.”

It’s All About Options

The panelists pointed out the generational differences between her and her candidates, saying that this could be the cause of the change of behavior. But I wanted to probe a little deeper, because I wasn’t so sure technology was the culprit here:  “I suspect that when you’re recruiting, your motivation to connect with a candidate is not always the same as their motivation to contact you,” I said.

“It’s your job and top of mind, but for them, you’re just an interruption in what they were already doing. They may not be ready to have a chat with you,” I continued. “Twenty-five years ago, when we were starting our careers, the phone was the only choice for instantaneous, ‘at-a-distance’ communication. But now, we have many choices, thanks to technology. So, they have options and they’re picking the one that’s appropriate. They’re time-shifting the interruption to a time more convenient, when they’re more motivated to contact you. I suspect that if we had that choice 25 years ago, we would have done the same thing. Technology hasn’t changed us, it’s just given us more options to do the things we really want to do.”

The Human Act of Searching

So why is that important for Siri, Apple and Search? Well, just as we had to adapt to the phone as an instant communication channel, we’ve had to adapt to the interface that search gave us to seek information. Let’s face it; typing words into a box is not the way we evolved to communicate. We talk. We touch. We listen. We see. We’ve had to adapt to a non-organic, structured format — 10 blue links in a list — because we had no choice. It was all the technology would allow at the time.

Also, separating the acts of retrieving information and doing something with the information is not natural for us either. We’re used to a tighter connection between the two. Information is seldom an end point. Doing something with the information is a much more common objective.  But up to now, search could only really act as an information retrieval tool.  It was powerful, and we adapted quickly because we recognized the power, but it wasn’t natural.

But look at what Siri and Apple are trying to do: On this platform, search is asking for something, getting it and immediately doing something with it. Sound familiar? It should. It’s what we’ve done for most of our history as humans. And that’s what technology, at it’s best, should do: give us more ways to be human.

Human Irrationality Online

irrationalLast week, I talked about the work of Daniel Kahneman, Amos Tversky, Herbert Simon and George Akerlof, key figures in helping define the foundations of consumer behavior, both rational and irrational, that dictate the realities of the marketplace. Today, I want to talk about how these emotional and cognitive biases and limitations play out online, but first, a quick recap is in order:

Prospect Theory – The role of psychological framing and emotional biases in determining human behavior in risky economic decisions. For example, how we’re more sensitive about loss than we are about gain.

Bounded Rationality – How we cannot endlessly consider all alternatives for the optimal behavior, but rather rely on “gut instincts” to help sort through the available alternatives.

Information Asymmetry – Why the marketplace has traditionally been unbalanced, with the seller almost always having more information about the product than the buyer.

This is Nothing New…

As I said last week, these are all hardwired human conditions that have been present for hundreds of generations, even though it’s only been recently that we’ve learned enough about human behavior to recognize them. And it’s these inherent tendencies that have changed the marketplace since the introduction of the Internet. The huge volume of information available online allowed us to shift the balance of the marketplace to be more equitably distributed between sellers and buyers. Let’s explore how each of these occurrences drove the behavioral change, which was enabled, not caused, by the introduction of the Net.

We understand that risk is present in almost all consumer transactions. This fact brings Prospect Theory into the picture. We will unconsciously employ our emotional biases to deal with the risk inherent in each purchase: the greater the risk, the greater the degree of bias.

The Risk/Reward Balance

Consumer motivation relies on us mentally balancing risk and reward. The balance between these opposing forces will dictate how we deal with risk mitigation. If there is a high reward — for example, buying our mid-life crisis sports car or taking our dream vacation — our emotional biases will be tilted towards maximizing this reward. Consumer research is really more about wish fulfillment than it is about risk mitigation.

But if there is little or no reward, our research takes a much different path. Think about how we approach the purchase of life insurance, for example. There is no inherent reward here, just risk — or rather, mitigation of risk. And insurance salespeople mercilessly exploit the emotional bias of loss by getting you to picture your family’s future without you in it.

Informed Does Not Always Equal Rational

This risk/reward balance will dictate what our online research will look like. And this is where Akerlof’s Information Asymmetry comes in. One of the ways we mitigate risk is by educating ourselves about our purchase. We look up consumer ratings, read reviews and pore over feature sheets.

Today, consumers are much more informed than they were a generation ago. But all that information does not necessarily mean we will make a more logical decision. We humans tend to look at information to support our emotional biases, rather than refute them. So, the balancing of information asymmetry is still done through the lens of our emotional and psychological frames, as shown by Kahneman and Tversky. We have access to information online, but each of us may walk away with different messages, depending on the lens we’re seeing that information through.

All This Information, All These Choices…

And that, finally, brings us to Simon’s concept of Bounded Rationality. We have more information than ever to sift through. As I said a few columns back, we can employ different strategies to make decisions. Some of us embrace bounded rationality, or satisficing, making us more decisive. It’s important to note here that the fact we’re trusting our gut to make these satisficing calls means that we may be trusting emotion rather than logic. Others try to optimize each decision, weighing all the variables. While this is perhaps a more rational approach, it can tax our cognitive limits, leading to frustration and often abandonment of the optimal path, resulting in a decision that ends up being a “gut” call anyway.

Our need to access information to mitigate risk has lead to the behavioral changes in consumer behavior. The Internet enabled this. It wasn’t technology that changed our behavior; it was just that technology opened the door to allow us to pursue our hardwired tendencies.

The Four Horsemen of the Consumer Behavior Apocalypse

First published March 25, 2010 in Mediapost’s Search Insider

Right out of the gate, let’s assume that we all agree consumer behavior is in the throes of its biggest shift in history. And the cause is generally attributed to the Internet.

While I don’t disagree with this assessment, I believe there may be some misattribution when it comes to cause and effect. Did the Internet cause our consumer behavior to change? Or did it enable it to change? The distinction may seem like mere semantics, but there’s a fundamental difference here.

“Cause” implies that an outside force, namely the Internet, pushed us in a new direction that was different from the one we would have pursued had this new force not come along. “Enable” is a different beast, the opening of a previously locked door that allows us to pursue a new path of our own volition. I believe the latter to be true. I believe we weren’t pushed anywhere. We went there of our own free will.

Free Will? Or Hardwired Human Behavior?

But, even in my last statement, language again gets us in a sticky place. “Will” assumes it was a conscious and willful decision. I’m not sure this is the case. I suspect there were subconscious, hardwired behaviors that had a natural affinity for the new opportunities presented by the online marketplace.

For most of our recorded history, we have assumed that rational consideration and conscious will forms the basis of human thought. If we did seem programmed automatically to respond to certain cues, this was as a result of being conditioned by our environment, the classic Skinner black-box approach. But when we were on top of our game, we were carefully considering pros and cons, making consciously deliberated decisions. These were the forces that drove our society and our behaviors. This theory formed the basis of economics (Adam Smith’s Invisible hand), Cartesian logic, and most market research.

But in the last few decades, this view of rationality riding triumphant over human foibles has been brought into question. In particular, there were three concepts put forward by four academics that caused us to question what drove our behaviors. These folks uncovered deeper, subconscious routines and influences that lay buried beneath the strata of rational thought. And it’s these subconscious behaviors that I believe found the new online opportunities so enticing. Let’s spend a little time today looking at these four thinkers and the new paradigms they asked us to consider.

Amos Tversky and Daniel Kahneman – Prospect Theory

Adam Smith’s Invisible hand, driven by the wisdom of the market, has been presumed to be the ultimate economic governing factor. The assumption was that each of us, individually making rational economic decisions, would ultimately decide winners and losers and capitalism would stay alive and well.

But Tversky and Kahneman, in their paper on Prospect Theory, showed that the invisible hand might not always be guided by a decisive and logical mind. We all have significant hardwired cognitive biases that often cause us to make illogical economic choices. For example, if I offered you $1,000, with no questions asked, or a chance to win $2,500 based on a coin toss, you’d probably take the sure bet, even though mathematically, the odds for net gain are better with the coin toss.

Prospect Theory shot some holes in the previous theory of Expected Utility, a model where we carefully weighed the pros and cons of a potential purchase based on a return on investment model. Emotional framing and risk avoidance played a much bigger role than we suspected, handicapping our logic and often guiding us down non-rational paths. Tversky and Kahneman single-handedly found the new discipline of Behavioral Economics and changed our thinking in the process.

Herbert Simon – Bounded Rationality

Simon’s concept of Bounded Rationality superseded Kahneman and Tversky’s theory, but it dovetailed with it very nicely. Even if we are rationally engaged in a decision, Simon argued, we couldn’t possibly optimize it, especially in complex scenarios. There were simply too many factors to consider. So, we took “gut feeling” short cuts, which Simon called “satisficing,” a combination of satisfy and suffice. We short-listed our consideration set by using beliefs and instincts.

To make the satisficing short list is the goal of any brand campaign. At some point, logical weighing of pros and cons has to give way to calls based primarily on instinct.  And, as Kahneman and Tversky showed, those instinctive calls may well be based on irrational emotional biases.

George Akerlof – information Asymmetry

The last piece, and the one that really drove the online consumer revolution, is George Akerlof’s Information Asymmetry theory. Traditionally, there has been an imbalance of information between buyers and sellers, to the seller’s advantage. The seller always knew more about what they were selling than the buyer did. This made purchasing inherently risky.

With an absence of information, consumers created strong beliefs about brands as a way to guide their future buying decisions. Brand loyalty, whether rational or not, filled the void left by a lack of information. Manufacturers and retailers carefully controlled what information did enter the marketplace, pushing the positives and carefully suppressing the negatives.

These three concepts, intertwined, defined the psychological make-up of the market prior to the introduction of the Internet. In my next column, I’ll explore what happened when these behavioral powder kegs were exposed to the fanned flames of the digital marketplace.

Search and Decisiveness

First published February 25, 2010 in Mediapost’s Search Insider

My last two columns (column 1 | column 2) explored decisiveness within a very defined scope: college students picking courses. I did that by analyzing an interesting study conducted by Wesleyan University, which used eye tracking to show how decisive and indecisive people differed in their processing of information.

In reading the study, my mind went back seven years to one of the first research studies Enquiro ever did (and still our most popular download): Inside the Mind of the Searcher. In it, we observed the behaviors of 24 individuals as they used search engines to carry out tasks. It was the first qualitative study we did, before we used eye tracking. But the Wesleyan study reminded me of some interesting insights from that study.

As we looked at the group, we started seeing some different search strategies, which we divided into four groups: The Scan and Clicker, The 2 Step Scanner, the Deliberate Researcher and the 1,2,3 Searcher.

Here is a brief description of each:

The Scan and Clicker (12.5% of our total group). These people scanned the top three or four results and clicked right away if they found something of interest. They were less likely than the 2 Step Scanners to return to the results set.

2 Step Scanners (25% of our total group). They’d scan the top results, same as the Scan and Clickers, and might click on a listing of interest, but would tend to “pogo stick” more, clicking through to a site, but then returning to the search engine and checking out at least one or two other sites before committing to one site.

Deliberate Researchers (41.6% of our total group). This group felt they had to scan the entire results set before clicking on a result. This group spent the longest time on the page, almost 40 seconds, compared to 15 to 20 seconds average duration for the other searchers.

The 1,2,3 Searchers (20.8% of our total group) This group worked down the results in order, seeming to consider each result individually. There didn’t appear to be as much back and forth consideration as we saw in other groups. Of course, we weren’t using eye tracking, so it was difficult to accurately track specific eye movements.

Now, these sessions were recorded seven years ago now, so I suspect some of the behaviors we saw were modified as people became more familiar with search engines. I’ve talked before about how we develop conditioned strategies through repeated tasks. Search is a prime candidate for this.

Decisiveness and Search Patterns

In looking back, it does seem that the same decisiveness vs. indecisiveness behaviors identified in the Wesleyan study were also appearing in ours.

One of the interesting things I’ve found in our own research, and something also alluded to in the Wesleyan study, is that you need to track behaviors in minute detail before you start to see the nuances that may indicate different underlying strategies. For example, we’ve seen aggregate heat maps that look almost identical between two groups, but it was only when we walked through the eye movements on a second-by-second (even a quarter-second-by-quarter-second) basis that we saw people taking significantly different paths to end up at the same destination.

The Wesleyan study found that under the pressure of time, indecisive people might abandon maximizing strategies to adopt “satisficing” behavior. This may yield similar results at the end, but can generate greater levels of stress and anxiety on the way to a decision.

I suspect decisiveness could be a critical factor in how we might navigate any Web page, including a set of search results. For example, how would decisiveness impact our interaction with the sponsored ads at the top of the page, or visually richer results? Great questions — currently with few answers.

I’ll see what I can do about that.

Maximizers vs. Satisficers: Why It’s Tough to Decide

First published February 18, 2010 in Mediapost’s Search Insider

In last week’s column, I introduced the study from Wesleyan University about how decisiveness played out for a group of 54 university students as they chose their courses.  The student’s eye movements were tracked as they looked at a course comparison matrix.

Weighing all the Options vs Saying No

In the previous column, I talked about two different strategies: the compensatory one, where we weigh all the options, and the non-compensatory one, where we start eliminating candidates based on the criterion most important to us. Indecisive people tend to start with the compensatory strategy and decisive people go right for the linear approach.  I also talked about Barry Schwartz’s theory (in his book “The Paradox of Choice”) that indecisiveness can lead to a lot of anxiety and stress.

The biggest factor for indecisive people seems to be a fear of lost opportunity. They hate to turn away from any option for fear that something truly valuable lies down that path. Again, this is territory well explored in Tversky and Kahnemann’s famous Prospect Theory.

The Curse of the Maximizer

Part of the problem is perfectionism, identified by Schwartz as a strong corollary to anxiety caused by impending decisions. The Wesleyan research cites previous work that shows indecisive people tend to want a lot more information at hand before making any decisions. And, once they’ve gone to the trouble to gather that information, they feel compelled to use it. Not only do they use it, they try to use it all at once.

The Wesleyan eye tracking showed that the more indecisive participants went back and forth between the five different course attributes fairly evenly, apparently trying to weigh them all at the same time.  Not only that, they spent more time staring at the blank parts of the page. This indicated that they were trying to crunch the data, literally staring into space.  The maximizing approach to decision-making places a high cognitive load on the brain. The brain has to juggle a lot more information to try to come to an optimal decision.

Decisive people embrace the promise of “good enough,” known as satisficing. They are less afraid to eliminate options for consideration because the remaining choices are adequate (the word satisficing is a portmanteau of “satisfy” and “suffice”) to meet their requirements. They are quicker to turn away from lost opportunity. For them, decision-making is much easier. Rather than trying to juggle multiple attributes, they go sequentially down the list, starting with the attribute that is most important to them.

In the case of this study, this became clear in looking at the spread of fixations spread amongst the five attributes: time of the class, the instructor, the work load, the person’s own goals and the level of interest. For decisive people, the most important thing was the time of class. This makes sense. If you don’t have the time available, why even consider what the course has to offer? If the time didn’t work, the decisive group eliminated it from consideration. They then moved onto the instructor, the next most important criterion. And so on down the list.

Tick…Tick…Tick…

Another interesting finding was that even though indecisive people start by trying to weigh all the options to look for the optimal solution, if the clock is ticking, they often become overwhelmed by the decision and shift to a non-compensatory strategy by starting to eliminate candidates for consideration. The difference is that for the indecisive maximizers, this feels like surrender, or, at best, a compromise. For the decisive satisficers, it’s simply the way they operate. If the indecisive people are given the choice between delaying the decision and being forced to eliminate promising alternatives, they’ll choose to delay.

This sets up a fascinating question for search engine behavior: do satisficers search differently than maximizers? I suspect so. We’ll dive deeper into this question next week.

Decisiveness and Search: Two Different Strategies

First published February 11, 2010 in Mediapost’s Search Insider

In “The Paradox of Choice,” author Barry Schwartz speculates that we all might be happier if we had fewer options in life. Our consumer-based society continually pumps out more and more options, forcing us into making more and more decisions. Schwartz convincingly draws a parallel between decisiveness and happiness. The less time we spend making decisions, the more we’ll be satisfied with our lives, he says.

A new study out of Wesleyan University explores the actual cognitive mechanisms of decisiveness. This has direct implications for search marketers, because every time we use a search engine, we’re forced to make decisions. In fact, every online interaction is a branching tree of decisions. The study provides new insight into the decision-making process we use as we guide ourselves through the online landscape.

Study Set-Up

The researchers at Wesleyan used a scenario familiar to their sample of 54 students: they had to pick courses for the upcoming semester. Course options were set up on a matrix that allowed students to evaluate their options on a few different criteria: time of the course, instructor quality, relevance, amount of work required and interest in topic. There were no “no-brainer” options. In each alternative, trade-offs were required.

The researchers also introduced a variable into the mix: the opportunity to delay final course selection.

Finally, they asked the students to use the course grid to help make their selections while using an eye-tracker to capture exactly what they looked at on the grid. After the task was completed, participants were asked to grade themselves on a standard decisiveness scale.

Decisive vs. Indecisive Strategies

Building on previous academic work on decisiveness, the researchers found that individuals tend to use two different strategies when making decisions.  The compensatory strategy tries to weigh all the decision attributes together, literally creating an evaluation formula in the decision-maker’s mind.  If there are five different decision criteria, all are considered at the same time and are weighted by the importance of each to the individual.

In a purely rational world, this would seem to be the optimal strategy, but as Schwartz pointed out, we are not rational decision-making machines. In their Nobel prize-winning work on Prospect Theory, Amos Tversky and Daniel Kahnemann  (and more recently, Dan Ariely) showed that we use irrational risk-triggered biases in our decision-making. These throw some significant wrenches into the workings of our decisiveness. Emotions get involved and we start feeling anxious. Decisions, even about things that will bring eventual rewards, start to cause us stress.

The other decision strategy is a non-compensatory, linear strategy. This is the foundation of Herbert Simon’s famous “satisficing” approach. Here, alternatives are quickly cut down by a sequential consideration of criteria, beginning with the one most important to the decision-maker. In the study scenario of picking courses, many looked first at the time the class would be taught, reasoning that if the time didn’t work for them, there was little point in considering the other things the course might offer. This quickly narrowed the consideration set. From there, they moved on to the next most important criterion. This sequential approach is relatively ruthless in eliminating candidates for consideration.

This study, along with others, found that indecisive decision-makers tend to start with a compensatory strategy, while decisive people start short-listing immediately with a non-compensatory strategy. In the next column, we’ll see how this difference in strategies was clearly shown in the eye tracking results. I’ll also explore how indecisive individuals are often forced to abandon one strategy for the other, which can cause significant stress.

The Psychology of Entertainment: Will Video Games Become Too Real for Us to Handle?

Man_Playing_A_Video_Game_1575481-310x416In yesterday’s post, I explored our psychological attraction to violent action thrillers. Today, let’s go one step further. What is the attraction of violent video games? And how might this attraction deepen and even become pathologically dangerous as the technology behind the games improves? It’s a question we’re speeding towards, so we should stop to consider it.

In TV and film, violent action triggers a chemical reaction in the brain that we find stimulating and pleasing. As cortisol and dopamine get released, we experience a natural high. Strong evidence points to a connection between sensation seeking (triggering the high) and addictive tendencies.

The Veil of Non Reality

There is a “veil of non-reality” that moderates this reaction however. The high we get from violent entertainment comes from the limbic structures of the brain, triggered by the amygdala and other sub-cortical neural modules. This is the primal part of the brain that ensures survival in threatening situations, which means that responses are fast but not deliberate. The higher, cortical parts of the brain ride overtop of these responses like a governor, toning down the responses and modulating the overactive danger response mechanisms. It our brains didn’t do this, we’d quickly burn ourselves out. Cortisol is a great stimulant when it’s needed, but a steady diet of it turns us into a quivering pile of anxiety-ridden stress.

When we watch entertainment, this modulating part of the brain quickly realizes that what we’re watching isn’t real and puts its foot on the brake of the brain’s natural desire to pump out Cortisol, dopamine and other neuro-chemicals. It’s the “voice of reason” that spoils the fun of the limbic brain. Despite the fact that there’s car’s exploding left and right and people are dropping like flies, the fact that we’re watching all this on a 2 dimensional screen helps us keep everything in perspective, preventing our brain from running away with itself. This is the veil of “non-reality” that keeps us from be fooled that this is all real.

The Imagined Reality of Entertainment

But let’s stop for a moment and think about how we’re consuming entertainment. In the past decade, screens have got bigger and bigger. It’s no coincidence that we get a bigger high from watching violence on the big screen than from watching it on a 20 inch home TV. The “veil of non-reality” starts to slip a little bit. It seems more real to us. Also, we feed off the responses of others in the theater. We are social animals and this is especially true in threatening situations, even if they are simulations in the name of entertainment. We pick up our social cues from the herd.

It’s not just the size of the screen that’s changing, however. Technology is continually trying to make our entertainment experiences more real. Recent advances in 3D technology have not only made James Cameron even wealthier, they also deliver a stronger sensory jolt. Watching Avatar in 3D is a sensory explosion. The veil of “non-reality” slips a little further.

But improvements in graphic technology can only go so far in fooling the brain. Much as our eyes might be deceived, we’re still sitting passively in a chair. Our interpretation of the world not only relies on input from the senses, it also relies on our own sense of “body” – Antonio Damasio’s somatic markers.

The Satisfaction of Control

This is where video games are quickly approaching a potential crisis point in sensory overload. Even the best Hollywood thriller requires us to sit passively and consume the experience. We have no control over plot, dialogue or the character actions. We can only engage in the experience to a certain level. In fact, much of the appeal of a Hollywood thriller comes from this gap between what’s happening on the screen and what’s happening in our own minds. We can imagine possible outcomes or perhaps the director gives us knowledge the protagonist doesn’t have. We experience suspense as we see if the protagonist takes the same actions we would. We silently scream “Get out of the house!” to the teenage babysitter when we know the psychopathic killer is upstairs.

But video games erase this limitation. With a video game, we’re suddenly in control. Control is a powerfully seductive condition for humans. We naturally try to control as many elements of our environment as possible. And when we can exert control over something, we’re rewarded by our brains and a natural hit of dopamine. That’s why completing a puzzle or solving a riddle is so inherently satisfying. These are tiny exertions of control. In a video game, we are the authors of the script. It is we who decide how we react to dangerous situations. Suddenly we are not a passive audience. we are the actors. This is cognitive engagement at a whole different level. Suddenly the appeal of sensory stimulation is combined with the rewards we get from exercising control over novel situations. That’s a powerful one-two punch for our brains. And the veil of “non-reality” slips a little further.

Virtual Reality

The negative impacts of video games have been studied, but again, like TV, studies have been largely centred around one question: does the playing of video games lead to increased aggression and violence in children? And, like TV, the answer seems to be a qualified yes. For those already prone to violence, the playing of video games seems to reinforce these attitudes. But it’s also been argued that the playing of video games provides a cathartic release for violent tendencies.

Less research has been conducted on the cognitive impact of video games, and it’s here where the bigger problem might lie. A few studies have shown the playing of video games could be addictive. A Japanese study found that excessive video game playing during adolescence seems to alter the way brains develop, impairing the ability to focus attention for long periods of time. In fact, a number of studies have shown links between exposure to excessive sensory stimulation through electronic media and the incidence of ADHD and other attention deficit disorders. It’s this longer term altering of how our brains work that may represent the bigger danger in video games.

Video games combined violent scenarios, which we know to provide sensory jolts to the brain, with the seduction of control. What has limited the addictive appeal of video games to this point are two things: how realistic the scenarios are perceived to be and the way we interact with the games. And, in both these areas, technology is moving forward very quickly.

Video game graphics have come a long way, but they still lack the photo realism of a typical Hollywood movie. However, the distance between the two is lessening every day. How far away are we from a video game experience that matches the realism of Hollywood? Huge advances in computer graphics and sheer processing power are bringing the two closer and closer together. The day is not far away where our experience in a video game will feel like we’ve been dropped in the middle of a movie. And, with 3D and virtual reality technology, even the physical separation of a screen will soon disappear. The imaginary world will surround us in a highly realistic way. What will that do for the “veil of non-reality?”

The other area where video games have improved dramatically is in the way we control them. The control pad with various triggers and buttons was a artificial way to interact with the video game world. A spin-jump-kick combination was triggered by pushing down a few buttons while we sat in a chair. This helped our brain maintain it’s distance from the imagined reality. But Nintendo’s Wii changed how we interact with video games. Sophisticated sensors now translate our own body motions into corresponding digital commands for the game. Even our bodies are fooled into believing we’re actually playing golf or participating in a boxing match. Interestingly, Nintendo made the choice to make the graphics on the Wii less realistic, perhaps trying to maintain a “veil of non-reality.”

The Wii opens the door to a much more realistic way of controlling video games. Now our own body movements control the virtual character. Suddenly, our body is providing reinforcing feedback to our brain that this might just be real. When you combine this with photo-realistic visual input and audio input, one could forgive our brains for not being able to determine what is real and what isn’t.

Entertainment Overload?

If technology continues down the path it’s own, the virtual reality of a video game may be indistinguishable from the true reality of our lives. If the “veil of non-reality” permanently slips, we have a huge potential problem: our lives pale in comparison to the sensory possibilities of a virtual world. That’s why our brains may not be equipped to handle the overload. We may get addicted to sensation as the brain is fooled into giving us stronger and stronger hits of cortisol, dopamine, adrenaline and other natural narcotics. When the “veil of non-reality” slips away forever, our brains may not be equipped to handle the new virtual reality.

The Psychology of Entertainment: How American Idol, Survivor and Dallas Hooked Us

In this series of posts, I’ve covered off at some length why we find some things inherently funny. We’ve also talked about the importance of connecting with characters in developing a long term loyalty to the show that separates the long running hits from the one season wonders. But obviously, there is more than just comedy on TV. There’s drama, Reality TV and Action Thrillers, all dealing with the same basic elements of characterization and narrative (even Reality TV, which is really unscripted drama). With this, let’s look at how some different shows have approached the challenge of long term loyalty.

What Made Some Show Hits?

Survivor

survivor logoSurvivor was the most successful summer replacement in history. It rocketed to popularity in 2000 and was responsible for the flood of reality TV we’re still saddled with. The popularity of Survivor, however, has dropped dramatically over the past few years. One possible reason is that Survivor forces you to reestablish connections every single season. The situation is more important than the characters in Survivor. Just as we start to care about a character, they get voted off the island. We watch Survivor like an anthropologist would, intrigued by the challenge and how the human cast reacts to it, but unable to form connections that endure from season to season. The producers realized this and started to bring back past favourites for an “All Star” survivor, hoping to re-establish past connections, but by then it was too late. Our interests had moved on. The connections had been discarded. Survivor had “jumped the shark.” Other reality shows, such as Big Brother and the Apprentice have faced this same inherent “shelf life” problem. In terms of gaining long term loyalty, characters we connect with will always trump intriguing situations, for reasons I explored a few posts back.

West Wing

WestwingMy personal favorite. But as I said in an earlier post, even my degree of connection with West Wing suffered after the third season. Writer Aaron Sorkin’s scripts demanded a high degree of investment on the part of the viewer. The byzantine tangle of situations, delivered through machine gun quick, impossibly clever dialogues, was more like intellectual gymnastics than a relaxing hour in front of the tube. Earlier this week, I talked about the psychological attraction of wit. We all wish we were wittier and the characters on West Wing, thanks to Sorkin, were impossibly clever and witty. It left you breathless just trying to keep up. However, Sorkin continually delivered huge returns on that investment. For me at least, West Wing hit highs I haven’t seen since. After four seasons, Sorkin moved on. Also, the inevitable cast churn started. Perhaps we were just worn out from trying to keep up, but in it’s last 3 seasons, West Wing continually lost steam.

Other long running dramas, including ER and Dallas (technically the most successful show in history, if you look at global syndication as a measure), relied on various formulas of social connectedness. ER wrapped in our preoccupation with health (another inherently wired hot button in humans) with rich characterizations. Dallas took the soap opera primetime, offering a shallower but undeniably fascinating tangle of greed, betrayal, sex, love and occasional redemption through the actions of more sympathetic characters. Dallas was like junk food for our brains, playing to our lowest psychological denominators. It’s a path many shows have followed.

American Idol

AmericanIdolSo, in the examples above, it appears we need an ongoing narrative to keep us engaged, right? Then how do I explain the success of American Idol? There is no narrative. And just like Survivor, the cast of characters changes each season. So why is American Idol the most popular TV show in recent memory? Well, it turns out that American Idol does rely on a narrative. It relies on our narrative.

If our connection with characters provides the glue that keeps us tuning in week after week, how would I explain the success of American Idol? While we might start identifying with one particular contestant, there is no real narrative that drives American Idol. It’s a talent show. And it’s not the only online success. America’s Got Talent, Dancing with the Stars, the Susan Boyle phenomenon. What is the mechanism at play here that entertains us? Again, it seems to come down to narrative, but in this case, it’s our narrative, not the characters, that proves to be the glue.

TV Provides a Reference Point for Ourselves

Our connectedness to characters seems to rely not so much on their situations, but on our own. Somewhere deep inside, we project their fantasy on our reality. The narrative of our favorite characters have to have some hooks or bearing points that we can anchor in on. There has to be some degree of affinity. We can relate to the situation (med students watching Grey’s Anatomy) or we can relate to a character’s qualities (I’d like to be Chandler Bing’s friend). We can fantasize about being in a character’s shoes (being Jack Bauer in 24) and we can care about a character’s well being (Will Schuester has to dump his wife and hook up with Emma Pillsbury). A TV show has to give us a reason to want to live our lives vicariously through it’s characters and situations. The formula for American Idol relies on the same hooks. We want to be on stage too. It’s the same hook that made Rock Band and Guitar Hero massive best sellers amongst video games.

What connection do we have with the contestants on these massively popular talent shows? Why are talent shows inherently appealing to us? Let’s return to Susan Boyle and Britain’s Got Talent. Why did we get a chill down our spine when this frumpy Scottish spinster suddenly opened her mouth and belted it out? Why was it so deliciously satisfying when the smirk was wiped from Simon Cowell’s face? Well, it’s because we humans travel in herds. Seriously.

Monkey See, Monkey Aspire to Do

Television Britain's Got TalentWe admired Susan Boyle. We admire talent when we see it. And we especially admire talent when it’s undiscovered. Why?

Joseph Henrich and Francisco Gil-White have a theory about that. They believe admiration is like a short cut to success. And unlike other species, where social prestige comes primarily through physical aggression, humans can take many paths up the social ladder. The examples of humans achieving social status through talent or intellectual ability far outnumber those succeed through physical domination. Our brain is our greatest asset and human society has evolved to recognize our unique advantage.

When we see someone suddenly winning a crowd over, we can’t help but feel chills of admiration going down our spine. (Here’s a link to the video on YouTube, just in case you’ve forgotten the sensation. It’s been viewed almost 90 million times) Their success could be our success. They provide a new potential path in our own personal narrative, a road to prestige that we to could go down. And the appeal of the talent show format is that these are undiscovered talents. Their current social status is not so different from our own. In fact, as in Susan Boyle’s case, based on appearance alone, we initially put ourselves several rungs up the social ladder. So, if Susan could suddenly soar up in social value, our odds must be even better (ignoring for the moment that we can’t sing like her). We measure our chances against the yardstick provided by Ms. Boyle. We can readily imagine ourselves in her no-nonsense leather shoes. It’s why we are predisposed to root for the underdog. And the more “under” the dog, the bigger the cheers.

What is the Darwinian logic to this behavior? It’s not so difficult to understand. The path to social success, and all the evolutionary advantages that accrue to one who attains it, is easier if you follow in someone else’s footsteps. We are a social animal and one of the advantages of that is that we can advance faster if we learn from other’s failures and triumphs. We are hardwired to both admire, criticize and topple fallen idols (a la Tiger Woods). Reality talent shows like American Idol and America’s Got Talent take full advantage of these behavioral traits.

So, we’ve covered the required elements of the drama, the comedy and Reality TV. But so far, I still haven’t touched one genre of TV entertainment, the action show. More on that next week.

The Psychology of Entertainment: Men, Women and How We Process Humor

Yesterday, I talked about context and it’s impact on comedy. What makes something funny in Scotland wouldn’t necessarily be as funny in Switzerland or South Africa. If different nationalities process jokes differently, there must be other dividing lines as well, right? Yes, and the biggest one is the line that segments the sexes. Men and women have significantly different humor processing hardware. Women tend to think before laughing, monitoring the social temperature before making a judgement about what’s funny. A man’s response tends to be less deliberate, a more direct connection to our primal “humor” centres.

And it’s this divide in the senses that provides some clues on the mechanisms used to process humor. Studies have found that unless both the right and left hemispheres of the brain are fully engaged in the task of processing humor, we won’t find a joke funny. This is why you never find a joke funny if it has to be explained to you. If we use the left hemisphere (the logical side) of our brain to analyze a joke too extensively, it ceases to be humorous. The suddenness of the gap closing, the elimination of incongruity and the feeling of mastery is no longer there. You’ve taken too long a road to the punchline and the humor got lost on the way.

In humans, humor seems to be a balancing act between the left and right hemisphere. The left gets the facts in order, and the right seems to provide the synthesis that produces the humor. Neurologists have found that patients with lesions to their right hemisphere can understand the “logic” of a joke but simply won’t find any humor in it. Knowing that an interplay between the hemispheres is required to produce humor explains the differing responses from men and women when it comes to what’s funny. Women have more robust wiring between the right and left hemispheres.  The important thing, however, is that we process humor subconsciously. As I said yesterday, if we stop to think too long about a joke, it ceases to be funny.

The Difference between Slapstick and Wit

three_stoogesYesterday, I talked about what makes a baby laugh. In effect, I stripped humor down to it’s essential building blocks. But, as we get older, we get more sophisticated. We move beyond the universal foundations of humor and start to develop tastes. Some of us love Oscar Wilde. Some of us love Tyler Perry. So, what is the difference between high brow and low brow humor?

Why do we laugh when other people hurt themselves? Why was it funny when Larry slapped Moe, or poked Curly in the eyes? What kind of sick, sadistic bastards are we? The Germans even coined a word for it: Schadenfreude – which translates literally as “joy from adversity”.

There is a double punch-line to slapstick comedy. The first comes from the fact that laughter and danger live in the same parts of our brain, as I explained in yesterday’s post. We have an immediate and complex reaction to physical calamity. It surprises us, which triggers the appropriate part of the brain, which in turn responds with a double hit of fear and laughter. Which side of the dividing line we end up depends on the seriousness of the calamity. Minor bumps on the head (when they happen to others), slips, falls, knocks and bumps can all trigger laughter as an immediate response. If the damage is more seriousness, our laughter quickly turns to concern. Remember yesterday when we looked at how a 5 month old’s laughter is triggered by conquerable danger, in a playful setting? These same mechanisms stay in place throughout our lives and partially explain our response to other’s physical misfortunes. In comedy, Slapstick is stylized so that we can be certain nobody is getting hurt too badly. Facial expressions, sound effects and mock moans all signal that this is just good fun. Look at the picture of the Three Stooges I included with this post. No one could look at the expressions on those faces and make the mistake of thinking that there’s anything remotely serious about the ear twisting that’s going on. We distance the physical violence from the result of that violence. It’s the entire premise of the game show Wipeout, as well  as 85% of the clips on America’s Funniest Home Videos.

The Social Side of Humor

But there’s more to it than just a mixed up fear/laughter response. Humor depends on our social radar. It depends on how we position ourselves in our social network. This is where the Schadenfreude part of the equation plays out. We find it funny when  Wile E. Coyote falls off a cliff but we don’t when the same fate befalls the Road Runner. Why? Because Wile is the bad guy and the Road Runner is the good guy. Archetypes are important in comedy. This goes back to Aristotle’s rules for drama: bad things can happen to bad people, good things are supposed to happen to good people, but when those two get mixed up, it’s a lot less satisfying to us. Schadenfreude works best when the good/bad roles are clearly defined.

So, how do we define Schadenfreude for men vs women? This is another place where males and females diverge in their opinions of what we find funny. In men, it typically plays out in terms of physical violence. We men laugh when others get hurt. With women, it’s more often defined as a social comeuppance. Women laugh at social ostracization.

Tom Green vs Kate Hudson: Guy’s Movies & Chick Flicks

Let’s visit the 6th grade school yard at lunch time. Over in this corner we have a group of guys laughing. What are they laughing about? Chances are, it’s something to do with some type of bodily emission or various parts of the male and female anatomy and how they might interact. Guys are, on the average, predictably base about what we find funny. And much as I wish we outgrew this, a quick glance down what’s currently playing at the local Cineplex will probably prove me right.

But there, over in the other corner, is a group of girls laughing. What are they laughing about? Chances are it’s not about farting or doody. It’s more likely laughter at the expense of some poor unfortunate distant member of their social circle. Social status is a key ingredient in comedies aimed at women, usually with a romantic twist thrown in.

High Brow Humor

Do we ever rise above the limitations of our base instincts when it comes to humor? Thankfully, yes. Many of us appreciate wit for it’s own sake. So, what is it about the witty remark that we find so appealing?

Perhaps the answer can be found in how we respond to wit. A witty remark almost never elicits a belly laugh. Witty remarks cause us to smile. A chuckle is usually the most we can hope for. Belly laughs are usually reserved for more physical types of comedy. Why the difference? Let’s return to our 5 month old. Babies both smile and laugh. They laugh during rough housing and more robust play sessions. They smile when they recognize the face of their mother or a grandparent. Laughter seems to come from our danger/humor circuit. Smiling comes from a more social place in our brain. In chimpanzees, a smile signals social submission. So, what does this have to do with wit?

We admire wit. We aspire to be witty. We identify with the mental acuity that typifies a witty person. We all want to be Chandler Bing, Conan O’Brien or, in an earlier age, Dorothy Parker. Wit is a signal of social station. Again, we find that what we find funny and what we find socially desirably are inextricably linked.

Wit has truth in it; wisecracking is simply calisthenics with words. – Dorothy Parker

Now that we’ve looked at what we find funny, on the next post I’ll return to a question I started to ask: what separates a TV hit from a miss?