Foraging for Information with Search

First published July 10, 2008 in Mediapost’s Search Insider

In my last column, we looked at berrypicking as an analogy for gathering information. The theory was put forward in 1989 by Marcia Bates. Then, in 1995, two researchers found even more inherent behaviors demonstrated in the way we seek information. It turns out that we may literally hunt for information.

The Genetic Case for Searching

We didn’t come equipped with an inherent strategy to pull information from a Web search results page. There is no genetic coding specific to Google. But as two researchers at Xerox’s PARC research facility, Peter Pirolli and Stuart Card, really started to explore how humans navigated online environments looking for information in 1995, they found something fascinating. They found that the way we seek information online is very similar to an activity that is as old as evolution itself: the hunt for food. Pirolli and Card called this the information foraging theory.

The basic principle behind information foraging is not so much about gathering the maximum amount of information, but rather in maximizing our time and efforts in pursuit of the right information. This goes to the human knack for conserving our resources in pursuit of our objectives.

The Easiest Route to Information

We must remember that any interaction with a search engine is part of a much broader range of activity that will hopefully result in achieving a large objective that is aligned with a human drive: learning, bonding, acquiring or defending (Nohria/Lawrence ). We take these macro objectives and break them up into distinct tasks and allocate resources against those tasks based on the expected usefulness of the outcome. This is where the food-gathering analogy provides some useful perspective.

We eat food to survive. Food is the fuel that powers our activities. In the stripped-down logic of evolutionary survival, it doesn’t make sense to expend more energy in the pursuit of food than the food itself contains. We would starve and die. So we have become remarkably effective at finding food in the easiest way possible. The big objective of the pursuit of food and survival is broken down into discrete tasks or actions, and we instinctively determine how much time and effort to spend on each of these tasks or actions depending on how much closer it will get us to the objective: our next meal. There is a cascading series of risk/reward decisions and mental trade offs happening below the level of our rational awareness. Our evolutionary programs play themselves out subconsciously.

Born Foragers

While seeking information is a more abstract concept than finding food, Pirolli and Card argue that the same inherent skills are used, including the same trade-off decisions. In evolutionary terms, our information-seeking skills are an adaptation of our food-gathering skills. Each time we seek information, we “hunt” for it and make decisions about how much cognitive energy we want to expend in the pursuit and the optimum strategy for gathering the information. We forage for information.

This explains much of the typical behavior we see with online properties, especially search. We quickly seek and filter through information, using our heuristic guidelines and trade-offs.

And when we look at our use of search engines, there are two important concepts put forward by Pirolli and Card that must be considered: the importance of information patches and diets.

The Right Patch and The Right Diet

As we seek information, the same as seeking food, we will spend our time where the promise of successful pursuit is the greatest, based on clues or telltale hints we encounter. We look for the best information “patch,” which is determined by information “scent,” the smell of informational relevance. The greater the scent, the greater the promise of an abundant information patch.

Search engines give us the ability to create our own patches, somewhat like a spider spinning a web to catch prey. We see what we catch based on the scent, and if we don’t like what we see, we quickly spin another web with another query. There is almost no effort expended in the process, so we have little patience if we’re not presented with adequate scent. This is why so much time is spent scanning the top of the page. I call it the area of greatest promise, that tiny yet critical patch of real estate in the extreme upper left corner of the search page, where we expect the strongest scent, figuratively. We judge the value of the whole patch based on what we see in the first few words in the first few listings on the page. If we don’t find strong scent, we start questioning the value of the patch.

But we also have to make a determination of which information we include in our diet. Remember, it makes no evolutionary sense (assuming we’re using the same mechanisms we use for foraging food) to expend energy pursing food that doesn’t return an equal or greater return on our investment. So we will quickly filter out low-quality information. In fact, if we think a patch contains only low-quality information, we’ll exclude it from our diet.

Search has been remarkably successful in becoming the preferred “patch” for a diverse set of information needs, but it still comes up short in one particular category. It doesn’t do very well at helping us find information when we don’t have a clear idea of what we’re looking for. Search is still rather ineffective as a “discovery” engine. But despite its limitations in this area, we have still been increasingly conditioned to turn to search when we forage for information because of its remarkable efficiency.

Berrypicking Your Way through the Web

First published July 3, 2008 in Mediapost’s Search Insider

In the last three columns, I explored the fundamentals of humans seeking information. To refresh your memory, the purpose of this series is to explore the importance of branding on the search page. Taking several steps back to begin my run at this topic (and risking a series that is “long and extremely wind baggy,” in the words of one reader), we’re now starting to get at some of the important concepts to understand how we interact with a search results page.

Bates and Berrypicking

In 1989, Marcia Bates took a fresh look   at the classic model of information retrieval that had dominated for the previous 25 years. The model was a fairly straight equation, with on one side a collection of documents and how the contents of those documents were represented, and the seeker’s information need and the query they constructed to express that need on the other side. In the middle was the desired outcome, the match of query and document representation. Bates found this admirably simple equation didn’t hold up too well in real-world search situations, especially given the advances in information technology.

The problem with the classic model was that it assumed that the successful search for information was a relatively static event, where one search and retrieval strategy took you eventually to the desired information. Even if you took into account feedback and iterative query refinement, it still looked at the process as a continual and linear one, with incremental progress towards a constant goal. In looking at actual behavior, Bates found that the process was more complex. As we pursued the information we thought we wanted, she found the path was less a straight line and more a looping and meandering path. In fact, it reminded her of picking huckleberries, hence the title of her theory, berrypicking.

Meandering through the Web

Bates found that as we start down the path to the information we seek, we pick up bits of information a little at a time, like picking berries. What’s more, as we pick the berries, we may head off in different directions depending on the information we gather. We follow the berries to more promising clusters of berries, or “patches.” We don’t just refine our queries, we change search and retrieval strategies, the places where we think we’ll find information (our “patches”) and, in the more extreme cases, our ultimate destination. Search is an evolving behavior, not a linear one.

Bates looked at 6 different strategies that academics use to search for information: footnote chasing (backwards chaining from articles of reference, tracking back footnotes); citation searching (forward chaining, using a citation index to jump forward); journal run (using authoritative journals on a subject and going through the entire run); area scanning (using the physical location of a subject in a library on the assumption that relevant materials will be in the same location); abstracting and indexing searches (using organized bibliographies and indexes, usually arranged by subject area); and author searching. At the time of her paper (1989), Web search was still unknown. The first search engine (Archie) would be created in 1990 at McGill University. But as you look at the six methods outlined, it’s clear that Web search lets you do any and all of them.

The Web: The Ultimate Berry Patch

Bates theorized that berrypicking would play out in different environments and you would change strategies as you went from environment to environment. The timeline could be days, weeks or even months. But with the Web and search, you could go from strategy to strategy in seconds, berrypicking your way through the Web. What’s more, you could be diverted from your original path through a serendipitous display of information that catches your attention. For example, you could be footnote chasing (i.e., the source link for a snippet of a review on one page) which leads you to launch a search for other reviews. There you see results for a magazine dedicated to the topic (an example of journal run), a link for other consumer reviews (citation searching) and a book title written by an authority on the subject (author searching). You’ve just used all six of the strategies outlined by Bates in one session, as you used abstracting and indexing (this is ultimately what a search engine is) and area scanning (in this case the physical collocation is defined by the search page real estate).

When it comes to the impact of branding on search, it’s important to understand Bate’s berrypicking model. Any search result could represent a “berry” that could lead us to an entirely new patch. Our search path could evolve in a totally new direction based on what we pick from a page. We can be introduced to brands or have them reinforced as we berrypick our way along.

In the next column, we’ll continue to redefine information retrieval by looking at the Information Foraging theory.

The Quest for Information

First published June 26, 2008 in Mediapost’s Search Insider

The third in my series in looking at how we search and how it might impact our brand relationships. Today, I look at how the emergence of Web search marks a dramatic leap forward in our quest for information.

The Great Library of Alexandria, built in 300 BC, was designed to hold all the knowledge of man. The dream of Ptolemy II was to assemble all the scrolls of the world in one place. Last week we explored why we sought knowledge. The Ptolemaic library was the first attempt to create one single repository for that information. Unfortunately, the media for recording knowledge was papyrus, which proved to be unpredictably flammable. The library burned not once but several times.

One of the challenges of seeking information is that it tends to be spread out and difficult to access. As we saw last week, when we seek information, we tend to either know what it is and where to get it, know what it is but not where it is, or, most challengingly, we don’t even know what it is we’re looking for.

Organizing the World’s Information

Google’s quest, picking up where Ptolemy left off, was to organize the world’s information. This is the big hairy audacious goal of all big hairy audacious goals. It’s never been accomplished before in the history of man. But Google is betting that it can be done thanks to the migration of information to a digital format.

In seeking information, humans will take the path of least resistance. This is not to say humans are inherently lazy. Like many things that come from evolutionary psychology, we have a tendency to reduce human behaviors to overly simplified maxims — and the inherent laziness of humans is one such oversimplification. It is true, however, than humans are inherently thrifty with our energy expenditures. Harvard professors Paul R. Lawrence and Nitin Nohria, in their book “Driven: How Human Nature Shapes our Choices,” theorize that humans are driven by four basic drives: The drive to acquire, the drive to bond, the drive to learn and the drive to defend. As we pursue these drives, we constantly balance effort vs. rewards. We will pursue the things important to us, but we will generally find the easiest means to our ends. This is particularly true of intellectual effort, where many cognitive short cuts are prewired and are triggered without our conscious awareness.

The Irresistible Lure of Web Search

This is why search has become such a  fundamental human activity. The aggregation of information that sits just a few keystrokes away is a tremendously engaging prospect for us energy-efficient humans. We will take the easiest path to retrieve the information and do it in a brutally efficient way. Search interfaces have to be intuitive and sparse. The more complicated the task, the less attractive it is to us. This is why search tools that ask us to do any more than type in the bare minimum of keywords will ultimately fail if there’s an easier choice. And this is why Google has become a habit for us.

But what about intent? Different types of searches may require different interfaces and treatment of results. Again, we make expenditure/reward calculations at an instinctive level based on our experience and knowledge. We decide which actions will be most likely to yield the information we seek. As you explore human nature, one of the most striking discoveries is just how sophisticated our subconscious energy conservation mechanisms are. Habits, emotions, instincts and other non-rational drivers guide us to make split-second decisions that should provide the best results with the least effort, and they are usually remarkably accurate. They have been field-tested and encoded into our genes by natural selection for generation after generation.

Picking the Right Path to Information

There’s another factor at play here, our level of confidence that past behaviors will continue to yield satisfactory results in the future. And this is part of a largely subconscious decision process when we chose the path to the information we seek.

Remember, when we seek information, we fit into one of three categories: we know what we’re looking for and where to find it, we know what we’re looking for but don’t know where to find it, or we don’t know what we’re looking for or where to find it.

Search engines fit the first two categories quite nicely. The first category leads to the huge volume of navigational search we see online, where we’re looking at search to connect us to the right page on the right site. And the second category gives us the more typical search behavior, where we tell the engine what we’re looking for and it provides it suggestions of the best place to find it.

It’s the third category where search engines struggle. When we don’t know what we’re looking for or where to find it, it’s difficult to find the words for our query. It’s in this category where search engines are trying to break new ground, by becoming discovery engines.

So, how has evolution equipped us to look for information? In the next column, I’ll look at information foraging, information scent and berry picking.

Why Do We Search?

First published June 19, 2008 in Mediapost’s Search Insider

This is the second in a series exploring the question of how we interact with search pages and the impact on brand relationships. Today we look at why we search in the first place.

Let’s begin with perhaps the most fundamental question ever asked in this industry. Why do we search? I’ve been in this industry for over 12 years now, and I’m not sure I’ve ever heard an answer to it. Why do we seek information? Is this need cultural or inherited? Is how we seek information changing?

 

The Roots of Curiosity

We search because we are curious. And curiosity comes from chaos. Curiosity allows us to survive in a dynamic and unstable environment. The more things change, the greater our curiosity. It keeps us alert and looking for the knowledge we need to survive. So the drive to be curious is inherited, but the degree of curiosity is cultural. Our environment determines how curious we are. If nothing changed, we wouldn’t need curiosity. So it’s probably not coincidental that for some of us, curiosity declines as we age. We seek more stable environments. Our need to monitor and adapt to our environment decreases, and with it, our need to learn.

We seek information for many reasons. Remember, almost every action we take is driven by emotion, but there is usually a rational justification that accompanies it. Our emotions and our reason work together to pick the best possible path for us. Antonio Damasio has done extensive research in this area, referring to our emotional cues, our gut instincts, as “somatic markers.” Rational thought needs information, and information, in turn, feeds our emotions. Information is essential grist for our curiosity mill.

Essential Information

Information is key in everything we do. Either we have this information stored in our brains–allowing us to conduct the task in question or function normally–or we don’t, causing us to seek it. The problem in seeking information is not one of quantity, it’s one of quality. There has never been more information available, but it can be difficult finding the right information. In our culture, a huge part of our cognitive effort is spent filtering out the onslaught of information that bombards us every day. No culture in history has been surrounded by more information than our present one, and it’s expanding exponentially.

Sometimes our need for information is purely rational. We need information to complete a task (looking up a phone number, referring to a map, reading directions) or to learn something new. Sometimes our need for information is less clear-cut, tied in with the social machinations that make us human. Remember, gossip is a glue that binds our society, and gossip is nothing more than the gathering and sharing of personal information. So our information-seeking is often tied to an incredibly complex concept of social structure and status. Sometimes we seek information because we need it. Sometimes we seek information just because we want it. Information is a valuable currency in our society, and it can be one factor in determining social status. Obviously, the information gained from supermarket tabloids and searches for “Britney Spears” is of questionable value–but we, as humans, also have a need for this type of information. Information helps define political structure and alliances, in-groups versus out-groups, elevated status within a group and other purely social functions.

The Easiest Path to Information

Our quest for information comes from within and without. As we constantly scan our environment, we find situations we need to respond to. This can trigger a physiological and intellectual chain of events that requires information. We scan our store of information, retrieve what we have and identify what we don’t. Sometimes the need is immediate. We need the information now. Sometimes it’s far off and the information-seeking process is of much longer duration.

If we need to seek information because we don’t have it stored in our memory, most of us will take the easiest path. Our information retrieval habits will vary from person to person, but generally we seek to save energy, so we will take the shortest route to the information. And our path will be dictated by how well we know what we’re looking for. When we seek information, our quest can fall into three different categories: we don’t know what we’re looking for, we know what we’re looking for but don’t know where to find it, or we know what we’re looking for and where to find it. Which path we take to find information depends on where we feel it will be easiest to find the answer. When we talk about information-seeking and the ease of retrieval, the Web–and in particular, Web search–has been the most significant development in the history of man. That’s where we start in the next column.

Digging Still Deeper into the Search Branding Question

First published June 12, 2008 in Mediapost’s Search Insider

I love debate. I love defending my ideas, and in the process, shaping, refining and sometimes discarding them as they prove to be too unwieldy or simply incorrect. My last two columns have generated a fascinating debate around the concept of branding in search. Fellow Search Insider Aaron Goldman, comScore Chairman Gian Fulgoni, his senior vice president of search and media, James Lamberti, Erik du Plessis, Millward Brown executive and author of  “The Advertised Mind” (fascinating book, by the way), as well as a host of others, have taken up the debating gauntlet on this particular topic.

As luck would have it, we just wrapped up a study with Google in Europe — and data there seems to show that I’m dead wrong about the inability of unclicked search ads to build brand, reinforcing the view of Gian and Aaron (Aaron has his own research, and ours seems to support his findings). We saw brand lift (based on traditional metrics) of anywhere from 5 to 15% on even unclicked ads. And this was with thousands of respondents across four different product categories in three different markets, so I don’t think it’s an anomaly.

The easy thing would have been to toss in the towel and admit I was wrong. But I’m not so sure about that. I’m convinced the neurobiological underpinnings I outlined in my column two weeks ago are sound and that the reasons for the apparent contradictions lie in some aspects of the search interaction and brand recall that I overlooked and the metrics we use to measure them.

But, in looking at this, I realized that this topic lies at the heart of a fundamental and not-yet-explored aspect of search: how does it influence our brand relationships? In one regard, I’m wholly in agreement with Aaron, Gian and James. There’s a tremendous amount of branding value being left on the table with search. Where we differ is in the nature of that value. But that’s not an easy thing to explore. It’s certainly beyond the scope of a single column. So yesterday I sent an email to my MediaPost editor asking if I could use this column over the next several weeks to lay out my hypothesis for how we interact with search. Thankfully, she agreed. So, beginning this week, I’d like to begin unraveling that knot.

In my weekly columns over the next few months I’d like to explore several questions:

Why do we search: This goes to Aaron’s comment that we don’t always search for information about a purchase. And this is absolutely true. We search for many different reasons. I’ll look at what motivates us to search and our mental frame of mind when do so. Is searching a conditioned behavior?

Why we search the way we do: Through all Enquiro’s research, we have found very consistent search patterns. Why do we search the way we do? How do we forage for information? And why is a search engagement “thin,” while a Web site engagement is “thick”?

Why does searching trigger information retrieval, but doesn’t necessarily create new memories: I’ll look at how memory works, specific to the act of searching, and how this differs from other types of advertising.

Why we use search differently at different stages in our purchasing behavior: The way we use search early in the process can be significantly different than the way we use it later. And it’s not the classic search “funnel” you may think.

Why the traditional brand metrics used are not accurate measures of likelihood to purchase, especially when applied to a search interaction.

Why search can be the most important brand tool in a marketer’s arsenal, if it’s used in the right place. It’s a matter of understanding what search can do and what it can’t. And, even more importantly, understanding how to measure that value.

And finally, will the changing nature of search change the way it acts as a branding strategy?

In this process I hope to provide supporting research where I can (there’s little empirical research in this area). I’ll also be reaching out to others, including my debating partners, to capture their views as well. And, as always, I invite you all to join the conversation.

Branding, The Mind and Search

First published June 5, 2008 in Mediapost’s Search Insider

In my last column, I opened up the search “branding” can of worms regarding unclicked search ads and generated a fascinating discussion with Gian Fulgoni and James Lamberti from comScore, as well as Aaron Goldman from Resolution Media, who has unpublished research that sheds new light on the subject and counters my argument. I think it’s fair to say that the value of an unclicked search ad still needs further research to resolve the question.

If it proves that there is brand lift created, then the question of pricing models currently used comes back into play. As Lamberti mentioned, perhaps the problem is not the pricing model but the measurement methods. And, as Jonathon Mendez from Ramp Digital added, “Is Google leaving lots of money on the table? They’re the most insanely profitable company of our time — I think they know what they’re doing.”

How Much Value is There in Search?

Could it be that we’re all right? Could it be that there’s so much value in the search interaction that Google can be leaving money on the table and still be insanely profitable? I do believe that in the case of branding impact, there is a distinct difference in the nature of the impact of the search ad from almost any other form of advertising, which is the topic of this column.

As I said a few columns back, search is more than a channel. It’s a fundamental human activity, and the same things that may be working against search in an implicit engagement way are very much working for search in an explicit way. The nature of our engagement with search is much different from other advertising.

Daring to Define Engagement

The Advertising Research Foundation has been struggling with defining engagement as a cross-channel effectiveness metric for years now, without making much headway. The problem is that engagement with a TV ad is a totally different proposition than engagement with a search ad.

Let’s look first at TV. In the 1980’s, the ARF conducted a major research study called the Copy Research Validation Project (as referenced in “The Advertised Mind,” by Erik Du Plessis). The purpose of the study was to isolate the factors that were common in successful ads. What was the one factor most predictive of success, which was actually thrown in as an after-thought? Whether people liked the ad.

Before most ads can work, they have to get our attention. And we pay more attention to things we like. This led to a hyper-creative explosion in the advertising biz, as agencies churned out ads designed first and foremost to make us like them. Unfortunately, most ads forgot that once you get someone’s attention, you also have to sell something. And that can be a difficult balance to maintain. Our cues to switch selective perception to something that captures our attention and our natural defenses against unsolicited persuasion usually work counter to each other. And it’s in that dynamic abyss that 250 billion dollars of advertising — in the U.S alone — gets poured every year,.

Search: Likability is Not a Prerequisite

But search is different. You don’t need to like a search ad, because it doesn’t have to capture your attention. You’ve already volunteered that attention. Search is used to gather information about an upcoming purchase. You’re fully engaged. You’re focusing on it. There are no cognitive guards on duty, protecting you from unscrupulous persuasion.

There’s another difference. Other advertising interrupts you when you have no intention of considering purchasing the featured product or service. Search reaches you just at the time you’re most fully engaged in consideration. And there lies the tremendous value of search, as it opens the door to the most engaging interaction with a brand that there can be: the online visit.

The Most Effective Engagement Point

Once consumers have knocked on your door through search, you have a tremendous opportunity to engage them. They have expressed interest, they are actively and fully engaged, they’re looking for information and they are ready to be persuaded. In the universe of consumer motivation, all the planets are perfectly aligned. You simply cannot find a better touch point with a consumer than this.

But the key is, you have to let consumers drive that interaction. They may simply be looking for rational purchase validation information, they may be researching alternatives, or they may be looking to be emotionally persuaded. A Web site can do any and all of the above, but it has to be at the visitor’s imperative.

Do I think there’s tremendous brand value left on the table with search? Absolutely. And as James Lamberti from comScore said, uncovering that value lies first in better measurement. If we can prove the value, whether it’s implicit or explicit, that may indeed lead to a different pricing model. Let’s face it; we’re a long way from understanding online consumer behavior. As we gain more understanding, expect changes. Expect lots of them.

 

How Much Would You Pay for this Unclicked Search Ad?

First published May 29, 2008 in Mediapost’s Search Insider

As David Berkowitz mentioned a few columns back, comScore CEO Gian Fulgoni pondered the implications of the fact that 95% of Google’s search advertising inventory never gets clicked. All those millions and millions of impressions get thrown out there, just to fade away as a non event as soon as one leaves the results page. Our own research, which Fulgoni refered to, shows that presence at the top of the page does have an impact on brand awareness and propensity to buy. So, logically, even if a link is not clicked, there must be value there. Fulgoni wondered if perhaps Google was leaving significant amounts of money on the table with their cost per click model.

David looked at the implications of Fulgoni’s musings from a business model. I, staying on more familiar ground, would like to explore this from the user’s view. Ironically, although Fulgoni used our research to prove his point, I’m not so sure there is a latent brand impact from search if a link remains unclicked. Let me explain why.
Will You Remember Me?

There’s a distinct divide between the impact realized from interaction with the search results page and interaction after the click-through, on the Web site. And the difference lies in how the interactions get loaded into our brains. When the spotlight of attention is turned on, things go directly into the executive function mode of our brains, which is commonly called working memory. This is like a white board, where we gather the details needed to make decisions and store them. There are two limiting factors to working memory, capacity and duration. We can only load so much on this whiteboard, and it will remain only as long as we’re actively using it. After that, the board gets wiped clean, ready for the next decision.

When we’re using working memory, we’re fully engaging our rational loop. Things go directly to working memory. Depending on the importance of the information for us in the long term, we’ll either start creating the long-term memory hooks to retain it, or it will be left to be erased from short-term memory. Think of when you look up a phone number. Obviously, there is lots of other information on the page or Web site where you go, but you’re focused on just the number you need. You find the number and begin repeating it to yourself, effectively beginning the transition from short-term to long-term memory. The rest of the information you saw on the page, even if you were actively focused on it during the task, is almost mmediately wiped from your memory.

The memory hooks you create will depend on how long you need the number, and how often you use it. If this is going to be an oft-used piece of information, it will get stored for the long run in your semantic memory. If not, it will eventually wither away in memory purgatory, caught between the transience of short term and the enduring stability of long term.

Focus of Attention

When we interact with a search engine, our working memory is in high gear. We are very much focused on the task at hand, “berry picking” our way through the information presented on the search page. In split seconds, we filter our way through incredible amounts of information, seeking the cues of relevancy, or information scent, required to indicate which result best matches our intent. We don’t spend a lot of time qualifying the quality of the match. Click-throughs are low-risk investments. If we click through on a listing and it doesn’t provide what we’re looking for, we can easily click back to the results page and try another one. So we don’t spend a lot of time considering the results. We scan, filter and click. There’s little opportunity for unclicked messaging to pass beyond working memory and stick.

Fulgoni’s theory has one other thing working against it. Much brand impact is acquired implicitly. Even when we’re not focused on acquiring information, images, sounds and messaging are filtering into our brains at a subconscious level, there to help create our brand perceptions. But all interaction with the search results page is explicit, a very focused acquisition of information. Everything passes through executive function and working memory. There is no opportunity for brand messaging to sneak past the guard and find a nook or cranny of our cortex to lodge itself in. We’re diligently wiping the slate clean.

Fulgoni’s theory is interesting, but I’m not sure it holds up when we look at the neurobiology involved in the process. There is a tremendous branding opportunity in search, but unfortunately, it doesn’t lie in the unclicked ad. But more on that next column, when we look at the interaction on the search page, and what happens after the click-through.

The Human Hardware Series on Search Engine Land

I must say I’m having fun writing the Human Hardware series on Search Engine Land. What I wanted to do is take some of the inherent behaviors and cognitive limits of humans and explore how this impacts our online interactions. And yes, to me, that’s fun!

If, like me, you’re interested in the “why” of things, I think you might enjoy this series. I’ve written 3 installments so far:

Human Hardware: Working Memory

How we use our working memory to make decisions, the capacity limits of working memory, and how working memory and long term memory work together. I take a look at Herbert Simon’s work on bounded rationality and satisficing as a shortcut to making decisions.  I also explore Daniel Wegner’s theory of transactive memory in this column. Finally, I look at how working memory dictates how we digest search results.

Human Hardware: Men and Women

Humans come in two models: men and women. Despite rampant political correctness, there are distinct differences between us (in case you hadn’t noticed). This column looks at some of the cognitive and neurological differences (I tried to keep my comparisons from the neck up) and how it impacts things like shopping, navigating and asking directions, understanding conversations and spending time online. I spend some time outlining gender research differences we’ve seen in past usability studies.

Human Hardware: Dunbar’s Number

In part One of this two part installment, I pose this question: Do we have limits on how many friends we can make? Robin Dunbar, a British anthropologist, believes the answer is yes, and that number is 150, give or take a few. I look at Dunbar’s research and reasoning, and how this limit has impacted human evolution and our creation of social networks. I touch on the evolution of language, the Great Leap in human evolution (why we went from throwing rocks to creating art in what was relatively the blink of an eye) and the importance of grooming as a social glue.

I’m pretty pumped about this series, as it ties directly into my book research, so this has been a way to work out a few of the ideas. To be honest, I have no idea how many installments there will be in the series. Along a similar vein, and in case you missed it, you might enjoy the Google Habit series that ran on MediaPost and earlier in this blog. Just check the archives.

The Last Word on Breaking the Google Habit

First published March 13, 2008 in Mediapost’s Search Insider

When I started this series of columns, I had no intention of making it a series. But now, with the fifth (and final) installment, it looks like I may finally break this particular habit. It’s been fascinating for me. Hopefully it’s been equally interesting for you.

We Develop Strings of Habits

In last week’s column, I talked about environmental cueing and reinforcement. Here, cues in our environment (the ubiquitous toolbar search box, for example) trigger a habit, and the expected outcome (the delivery of relevant results) reinforces the habit. This creates a sustaining cycle.

But there’s one other aspect of habits that we should look at. We tend to develop habits as strings of events. One environment cue might trigger a series of actions. The classic example is those who need a cigarette when they have a drink. Some recent research paints a fairly bleak picture of North American society and shows how obsessed we are with habit-inducing cues. The “why” question poised was why French people were less obese than Americans, despite a diet high in fat. It turns out one major reason why is that Americans let external cues, such as which TV show is on, drive their eating patterns. We always have a bowl of Chunky Chocolate ice cream while we watch “Desperate Housewives.” The French tend to eat when they’re hungry, and stop eating when they’re full. For the French, eating is a joy. For Americans, it’s a habit.

Swimming Upstream

As I mentioned before, to break a habit, you have to intercept before the habitual behavior, rather than try to educate and modify after the fact. And the less thought required to execute the behavior, the harder the habit will be to break. If your habit takes a few seconds to do, the opportunities to intercept and kick in the rational brain are minimal. This provides a distinct challenge to anyone looking to usurp Google’s search crown. Searching is becoming easier than ever.

The competitors have to look at that split second that exists between the awareness of the need for more information and the instinctive move to the nearest search box to launch the query. It’s in that tiny sliver of time that the opportunity to break the Google habit exists.

Searchis Interruptis

So, given the fleeting nature of this opportunity, how do you grab it? One way is to anticipate the need of search before it happens. This is the implicit query work that Microsoft was experimenting with sometime ago. As you work on a task, potential search queries are monitored in the background and are presented to the user. But a constantly shifting window of potential searches would probably drive us all batty.

Another way is to integrate search at an application or OS level, making search even easier and inserting a habit-breaking context switch into that tiny sliver of indecision that exists between awareness and Google.

Attack the Weakest Links

But even integration of search at this level won’t be enough. Remember, we tend to give the advantage to the incumbent. We actively look for reasons to maintain the habit, and we ignore information that runs counter to our habitual choice. Even if a search alternative is one click less to get to, that alternative still has to provide a significant reason to switch. They not only have to beat Google at the game of search, they have to do it in a decisive way. For this reason, a competitor has to attack Google’s user base at the weakest point, the ones that are using Google because it’s handy, not the Google loyalists.

True User-Centricity

This brings us to my last strategy for breaking the Google habit: a truly user-centric search tool.

Up to this point, verticalization in search has taken one of two forms. Either engines have attacked a topic category (i.e. Business.com and B2B, Lawyers.com and legal services, Expedia.com and travel) or a type of content (i.e. Blinkx and Youtube for video, Technorati for blog posts). These approaches tend to be vulnerable because we are creatures of habit. Generally, we prefer to use one place to launch our searches. We’re already using Google for most of our searches, so if it can provide an equivalent experience to these vertical engines, it can quickly assimilate the traffic and squeeze the verticals out.

This is not as easy as it sounds. Google has yet to provide an equivalent experience in most of its verticals, but now that it appears that the default design of the search results page is no longer a sacred cow, I would expect the functionality gap to close quickly.

But what if we took a different approach? What if rather than verticalizing around a topic or content bucket, we verticalized around a type of user? What if we maximized the search experience for millennial males or female baby boomers? The verdict on personalized search seems to be that a one-size-fits-all solution is a long way off on the horizon, but an intermediate step might be to tailor an engine for a segment that shares similar needs and expectations. By focusing on a niche strategy, you might be able to break the Google habit, one segment at a time. In this way, you might be able to provide the discontinuous innovation needed to catch people upstream, before they get swept away with the Google tide.

Human Hardware Series on Search Engine Land

I’m kicking off another series in the Just Behave column on Search Engine Land. I’m calling it the Human Hardware series, and it it I’ll be exploring some of the inherent traits of humans and how they affect our online interactions. In the first installment, last Friday, I looked at working memory, channel capacity and satisficing, area I’ve explored in past posts. Here’s a brief excerpt:

As people start to dive into the human genome, it’s somewhat startling to find the lack of diversity in the human gene pool. As different as we all think we are, we actually are alike in many more ways. We share a remarkable similarity in our physiological and neurological make up. Added to this is the fact that there are several inherent traits we all share, the result of thousands of years of evolutionary tweaking. There are absolutely deviations from the norm, but as a quick glance at any bell curve will tell you, for any given trait or characteristic of humanity, including intelligence, loyalty, physical strength or the ability to juggle, most of us cluster around the center line, otherwise known as the norm. It’s the inherent limits of the vehicle we inhabit, our body.

And lest you start feeling too superior, we actually share 98.4% of our genetic material with chimpanzees, our closest evolutionary relative. There is more genetic diversity between two breeds of dogs than there is between us and the average chimp. In fact, apes and chimpanzees are genetically more divergent than chimps and humans. Try wrapping your mind around that one on your next trip to the zoo.

As we start looking at our success in predicting behavior, the peak of the bell curve for our target population is where we have to start. It helps to understand the human hardware issues, which form the foundation of our understanding of predicted behavior. From here, we can tilt our strategies to accommodate diversions in either direction from the norm.

Why is the human gene pool so shallow? It’s because we all come from the same place, a relatively small population of modern humans in Africa, some 150,000 years ago. Recent research has shown that genetic diversity lessens as we get further and further from Africa. And one particularly interesting study speculates that all blue eyed people come from the same common ancestor. Our family tree has remarkably few branches if you go back far enough.

The rest of the column can be read over at Search Engine Land. Next week I’ll be running Part Two, looking at the differences of men and women.