The Quest for Information

First published June 26, 2008 in Mediapost’s Search Insider

The third in my series in looking at how we search and how it might impact our brand relationships. Today, I look at how the emergence of Web search marks a dramatic leap forward in our quest for information.

The Great Library of Alexandria, built in 300 BC, was designed to hold all the knowledge of man. The dream of Ptolemy II was to assemble all the scrolls of the world in one place. Last week we explored why we sought knowledge. The Ptolemaic library was the first attempt to create one single repository for that information. Unfortunately, the media for recording knowledge was papyrus, which proved to be unpredictably flammable. The library burned not once but several times.

One of the challenges of seeking information is that it tends to be spread out and difficult to access. As we saw last week, when we seek information, we tend to either know what it is and where to get it, know what it is but not where it is, or, most challengingly, we don’t even know what it is we’re looking for.

Organizing the World’s Information

Google’s quest, picking up where Ptolemy left off, was to organize the world’s information. This is the big hairy audacious goal of all big hairy audacious goals. It’s never been accomplished before in the history of man. But Google is betting that it can be done thanks to the migration of information to a digital format.

In seeking information, humans will take the path of least resistance. This is not to say humans are inherently lazy. Like many things that come from evolutionary psychology, we have a tendency to reduce human behaviors to overly simplified maxims — and the inherent laziness of humans is one such oversimplification. It is true, however, than humans are inherently thrifty with our energy expenditures. Harvard professors Paul R. Lawrence and Nitin Nohria, in their book “Driven: How Human Nature Shapes our Choices,” theorize that humans are driven by four basic drives: The drive to acquire, the drive to bond, the drive to learn and the drive to defend. As we pursue these drives, we constantly balance effort vs. rewards. We will pursue the things important to us, but we will generally find the easiest means to our ends. This is particularly true of intellectual effort, where many cognitive short cuts are prewired and are triggered without our conscious awareness.

The Irresistible Lure of Web Search

This is why search has become such a  fundamental human activity. The aggregation of information that sits just a few keystrokes away is a tremendously engaging prospect for us energy-efficient humans. We will take the easiest path to retrieve the information and do it in a brutally efficient way. Search interfaces have to be intuitive and sparse. The more complicated the task, the less attractive it is to us. This is why search tools that ask us to do any more than type in the bare minimum of keywords will ultimately fail if there’s an easier choice. And this is why Google has become a habit for us.

But what about intent? Different types of searches may require different interfaces and treatment of results. Again, we make expenditure/reward calculations at an instinctive level based on our experience and knowledge. We decide which actions will be most likely to yield the information we seek. As you explore human nature, one of the most striking discoveries is just how sophisticated our subconscious energy conservation mechanisms are. Habits, emotions, instincts and other non-rational drivers guide us to make split-second decisions that should provide the best results with the least effort, and they are usually remarkably accurate. They have been field-tested and encoded into our genes by natural selection for generation after generation.

Picking the Right Path to Information

There’s another factor at play here, our level of confidence that past behaviors will continue to yield satisfactory results in the future. And this is part of a largely subconscious decision process when we chose the path to the information we seek.

Remember, when we seek information, we fit into one of three categories: we know what we’re looking for and where to find it, we know what we’re looking for but don’t know where to find it, or we don’t know what we’re looking for or where to find it.

Search engines fit the first two categories quite nicely. The first category leads to the huge volume of navigational search we see online, where we’re looking at search to connect us to the right page on the right site. And the second category gives us the more typical search behavior, where we tell the engine what we’re looking for and it provides it suggestions of the best place to find it.

It’s the third category where search engines struggle. When we don’t know what we’re looking for or where to find it, it’s difficult to find the words for our query. It’s in this category where search engines are trying to break new ground, by becoming discovery engines.

So, how has evolution equipped us to look for information? In the next column, I’ll look at information foraging, information scent and berry picking.

Why Do We Search?

First published June 19, 2008 in Mediapost’s Search Insider

This is the second in a series exploring the question of how we interact with search pages and the impact on brand relationships. Today we look at why we search in the first place.

Let’s begin with perhaps the most fundamental question ever asked in this industry. Why do we search? I’ve been in this industry for over 12 years now, and I’m not sure I’ve ever heard an answer to it. Why do we seek information? Is this need cultural or inherited? Is how we seek information changing?

 

The Roots of Curiosity

We search because we are curious. And curiosity comes from chaos. Curiosity allows us to survive in a dynamic and unstable environment. The more things change, the greater our curiosity. It keeps us alert and looking for the knowledge we need to survive. So the drive to be curious is inherited, but the degree of curiosity is cultural. Our environment determines how curious we are. If nothing changed, we wouldn’t need curiosity. So it’s probably not coincidental that for some of us, curiosity declines as we age. We seek more stable environments. Our need to monitor and adapt to our environment decreases, and with it, our need to learn.

We seek information for many reasons. Remember, almost every action we take is driven by emotion, but there is usually a rational justification that accompanies it. Our emotions and our reason work together to pick the best possible path for us. Antonio Damasio has done extensive research in this area, referring to our emotional cues, our gut instincts, as “somatic markers.” Rational thought needs information, and information, in turn, feeds our emotions. Information is essential grist for our curiosity mill.

Essential Information

Information is key in everything we do. Either we have this information stored in our brains–allowing us to conduct the task in question or function normally–or we don’t, causing us to seek it. The problem in seeking information is not one of quantity, it’s one of quality. There has never been more information available, but it can be difficult finding the right information. In our culture, a huge part of our cognitive effort is spent filtering out the onslaught of information that bombards us every day. No culture in history has been surrounded by more information than our present one, and it’s expanding exponentially.

Sometimes our need for information is purely rational. We need information to complete a task (looking up a phone number, referring to a map, reading directions) or to learn something new. Sometimes our need for information is less clear-cut, tied in with the social machinations that make us human. Remember, gossip is a glue that binds our society, and gossip is nothing more than the gathering and sharing of personal information. So our information-seeking is often tied to an incredibly complex concept of social structure and status. Sometimes we seek information because we need it. Sometimes we seek information just because we want it. Information is a valuable currency in our society, and it can be one factor in determining social status. Obviously, the information gained from supermarket tabloids and searches for “Britney Spears” is of questionable value–but we, as humans, also have a need for this type of information. Information helps define political structure and alliances, in-groups versus out-groups, elevated status within a group and other purely social functions.

The Easiest Path to Information

Our quest for information comes from within and without. As we constantly scan our environment, we find situations we need to respond to. This can trigger a physiological and intellectual chain of events that requires information. We scan our store of information, retrieve what we have and identify what we don’t. Sometimes the need is immediate. We need the information now. Sometimes it’s far off and the information-seeking process is of much longer duration.

If we need to seek information because we don’t have it stored in our memory, most of us will take the easiest path. Our information retrieval habits will vary from person to person, but generally we seek to save energy, so we will take the shortest route to the information. And our path will be dictated by how well we know what we’re looking for. When we seek information, our quest can fall into three different categories: we don’t know what we’re looking for, we know what we’re looking for but don’t know where to find it, or we know what we’re looking for and where to find it. Which path we take to find information depends on where we feel it will be easiest to find the answer. When we talk about information-seeking and the ease of retrieval, the Web–and in particular, Web search–has been the most significant development in the history of man. That’s where we start in the next column.

Digging Still Deeper into the Search Branding Question

First published June 12, 2008 in Mediapost’s Search Insider

I love debate. I love defending my ideas, and in the process, shaping, refining and sometimes discarding them as they prove to be too unwieldy or simply incorrect. My last two columns have generated a fascinating debate around the concept of branding in search. Fellow Search Insider Aaron Goldman, comScore Chairman Gian Fulgoni, his senior vice president of search and media, James Lamberti, Erik du Plessis, Millward Brown executive and author of  “The Advertised Mind” (fascinating book, by the way), as well as a host of others, have taken up the debating gauntlet on this particular topic.

As luck would have it, we just wrapped up a study with Google in Europe — and data there seems to show that I’m dead wrong about the inability of unclicked search ads to build brand, reinforcing the view of Gian and Aaron (Aaron has his own research, and ours seems to support his findings). We saw brand lift (based on traditional metrics) of anywhere from 5 to 15% on even unclicked ads. And this was with thousands of respondents across four different product categories in three different markets, so I don’t think it’s an anomaly.

The easy thing would have been to toss in the towel and admit I was wrong. But I’m not so sure about that. I’m convinced the neurobiological underpinnings I outlined in my column two weeks ago are sound and that the reasons for the apparent contradictions lie in some aspects of the search interaction and brand recall that I overlooked and the metrics we use to measure them.

But, in looking at this, I realized that this topic lies at the heart of a fundamental and not-yet-explored aspect of search: how does it influence our brand relationships? In one regard, I’m wholly in agreement with Aaron, Gian and James. There’s a tremendous amount of branding value being left on the table with search. Where we differ is in the nature of that value. But that’s not an easy thing to explore. It’s certainly beyond the scope of a single column. So yesterday I sent an email to my MediaPost editor asking if I could use this column over the next several weeks to lay out my hypothesis for how we interact with search. Thankfully, she agreed. So, beginning this week, I’d like to begin unraveling that knot.

In my weekly columns over the next few months I’d like to explore several questions:

Why do we search: This goes to Aaron’s comment that we don’t always search for information about a purchase. And this is absolutely true. We search for many different reasons. I’ll look at what motivates us to search and our mental frame of mind when do so. Is searching a conditioned behavior?

Why we search the way we do: Through all Enquiro’s research, we have found very consistent search patterns. Why do we search the way we do? How do we forage for information? And why is a search engagement “thin,” while a Web site engagement is “thick”?

Why does searching trigger information retrieval, but doesn’t necessarily create new memories: I’ll look at how memory works, specific to the act of searching, and how this differs from other types of advertising.

Why we use search differently at different stages in our purchasing behavior: The way we use search early in the process can be significantly different than the way we use it later. And it’s not the classic search “funnel” you may think.

Why the traditional brand metrics used are not accurate measures of likelihood to purchase, especially when applied to a search interaction.

Why search can be the most important brand tool in a marketer’s arsenal, if it’s used in the right place. It’s a matter of understanding what search can do and what it can’t. And, even more importantly, understanding how to measure that value.

And finally, will the changing nature of search change the way it acts as a branding strategy?

In this process I hope to provide supporting research where I can (there’s little empirical research in this area). I’ll also be reaching out to others, including my debating partners, to capture their views as well. And, as always, I invite you all to join the conversation.

Branding, The Mind and Search

First published June 5, 2008 in Mediapost’s Search Insider

In my last column, I opened up the search “branding” can of worms regarding unclicked search ads and generated a fascinating discussion with Gian Fulgoni and James Lamberti from comScore, as well as Aaron Goldman from Resolution Media, who has unpublished research that sheds new light on the subject and counters my argument. I think it’s fair to say that the value of an unclicked search ad still needs further research to resolve the question.

If it proves that there is brand lift created, then the question of pricing models currently used comes back into play. As Lamberti mentioned, perhaps the problem is not the pricing model but the measurement methods. And, as Jonathon Mendez from Ramp Digital added, “Is Google leaving lots of money on the table? They’re the most insanely profitable company of our time — I think they know what they’re doing.”

How Much Value is There in Search?

Could it be that we’re all right? Could it be that there’s so much value in the search interaction that Google can be leaving money on the table and still be insanely profitable? I do believe that in the case of branding impact, there is a distinct difference in the nature of the impact of the search ad from almost any other form of advertising, which is the topic of this column.

As I said a few columns back, search is more than a channel. It’s a fundamental human activity, and the same things that may be working against search in an implicit engagement way are very much working for search in an explicit way. The nature of our engagement with search is much different from other advertising.

Daring to Define Engagement

The Advertising Research Foundation has been struggling with defining engagement as a cross-channel effectiveness metric for years now, without making much headway. The problem is that engagement with a TV ad is a totally different proposition than engagement with a search ad.

Let’s look first at TV. In the 1980’s, the ARF conducted a major research study called the Copy Research Validation Project (as referenced in “The Advertised Mind,” by Erik Du Plessis). The purpose of the study was to isolate the factors that were common in successful ads. What was the one factor most predictive of success, which was actually thrown in as an after-thought? Whether people liked the ad.

Before most ads can work, they have to get our attention. And we pay more attention to things we like. This led to a hyper-creative explosion in the advertising biz, as agencies churned out ads designed first and foremost to make us like them. Unfortunately, most ads forgot that once you get someone’s attention, you also have to sell something. And that can be a difficult balance to maintain. Our cues to switch selective perception to something that captures our attention and our natural defenses against unsolicited persuasion usually work counter to each other. And it’s in that dynamic abyss that 250 billion dollars of advertising — in the U.S alone — gets poured every year,.

Search: Likability is Not a Prerequisite

But search is different. You don’t need to like a search ad, because it doesn’t have to capture your attention. You’ve already volunteered that attention. Search is used to gather information about an upcoming purchase. You’re fully engaged. You’re focusing on it. There are no cognitive guards on duty, protecting you from unscrupulous persuasion.

There’s another difference. Other advertising interrupts you when you have no intention of considering purchasing the featured product or service. Search reaches you just at the time you’re most fully engaged in consideration. And there lies the tremendous value of search, as it opens the door to the most engaging interaction with a brand that there can be: the online visit.

The Most Effective Engagement Point

Once consumers have knocked on your door through search, you have a tremendous opportunity to engage them. They have expressed interest, they are actively and fully engaged, they’re looking for information and they are ready to be persuaded. In the universe of consumer motivation, all the planets are perfectly aligned. You simply cannot find a better touch point with a consumer than this.

But the key is, you have to let consumers drive that interaction. They may simply be looking for rational purchase validation information, they may be researching alternatives, or they may be looking to be emotionally persuaded. A Web site can do any and all of the above, but it has to be at the visitor’s imperative.

Do I think there’s tremendous brand value left on the table with search? Absolutely. And as James Lamberti from comScore said, uncovering that value lies first in better measurement. If we can prove the value, whether it’s implicit or explicit, that may indeed lead to a different pricing model. Let’s face it; we’re a long way from understanding online consumer behavior. As we gain more understanding, expect changes. Expect lots of them.

 

How Much Would You Pay for this Unclicked Search Ad?

First published May 29, 2008 in Mediapost’s Search Insider

As David Berkowitz mentioned a few columns back, comScore CEO Gian Fulgoni pondered the implications of the fact that 95% of Google’s search advertising inventory never gets clicked. All those millions and millions of impressions get thrown out there, just to fade away as a non event as soon as one leaves the results page. Our own research, which Fulgoni refered to, shows that presence at the top of the page does have an impact on brand awareness and propensity to buy. So, logically, even if a link is not clicked, there must be value there. Fulgoni wondered if perhaps Google was leaving significant amounts of money on the table with their cost per click model.

David looked at the implications of Fulgoni’s musings from a business model. I, staying on more familiar ground, would like to explore this from the user’s view. Ironically, although Fulgoni used our research to prove his point, I’m not so sure there is a latent brand impact from search if a link remains unclicked. Let me explain why.
Will You Remember Me?

There’s a distinct divide between the impact realized from interaction with the search results page and interaction after the click-through, on the Web site. And the difference lies in how the interactions get loaded into our brains. When the spotlight of attention is turned on, things go directly into the executive function mode of our brains, which is commonly called working memory. This is like a white board, where we gather the details needed to make decisions and store them. There are two limiting factors to working memory, capacity and duration. We can only load so much on this whiteboard, and it will remain only as long as we’re actively using it. After that, the board gets wiped clean, ready for the next decision.

When we’re using working memory, we’re fully engaging our rational loop. Things go directly to working memory. Depending on the importance of the information for us in the long term, we’ll either start creating the long-term memory hooks to retain it, or it will be left to be erased from short-term memory. Think of when you look up a phone number. Obviously, there is lots of other information on the page or Web site where you go, but you’re focused on just the number you need. You find the number and begin repeating it to yourself, effectively beginning the transition from short-term to long-term memory. The rest of the information you saw on the page, even if you were actively focused on it during the task, is almost mmediately wiped from your memory.

The memory hooks you create will depend on how long you need the number, and how often you use it. If this is going to be an oft-used piece of information, it will get stored for the long run in your semantic memory. If not, it will eventually wither away in memory purgatory, caught between the transience of short term and the enduring stability of long term.

Focus of Attention

When we interact with a search engine, our working memory is in high gear. We are very much focused on the task at hand, “berry picking” our way through the information presented on the search page. In split seconds, we filter our way through incredible amounts of information, seeking the cues of relevancy, or information scent, required to indicate which result best matches our intent. We don’t spend a lot of time qualifying the quality of the match. Click-throughs are low-risk investments. If we click through on a listing and it doesn’t provide what we’re looking for, we can easily click back to the results page and try another one. So we don’t spend a lot of time considering the results. We scan, filter and click. There’s little opportunity for unclicked messaging to pass beyond working memory and stick.

Fulgoni’s theory has one other thing working against it. Much brand impact is acquired implicitly. Even when we’re not focused on acquiring information, images, sounds and messaging are filtering into our brains at a subconscious level, there to help create our brand perceptions. But all interaction with the search results page is explicit, a very focused acquisition of information. Everything passes through executive function and working memory. There is no opportunity for brand messaging to sneak past the guard and find a nook or cranny of our cortex to lodge itself in. We’re diligently wiping the slate clean.

Fulgoni’s theory is interesting, but I’m not sure it holds up when we look at the neurobiology involved in the process. There is a tremendous branding opportunity in search, but unfortunately, it doesn’t lie in the unclicked ad. But more on that next column, when we look at the interaction on the search page, and what happens after the click-through.

The Human Hardware Series on Search Engine Land

I must say I’m having fun writing the Human Hardware series on Search Engine Land. What I wanted to do is take some of the inherent behaviors and cognitive limits of humans and explore how this impacts our online interactions. And yes, to me, that’s fun!

If, like me, you’re interested in the “why” of things, I think you might enjoy this series. I’ve written 3 installments so far:

Human Hardware: Working Memory

How we use our working memory to make decisions, the capacity limits of working memory, and how working memory and long term memory work together. I take a look at Herbert Simon’s work on bounded rationality and satisficing as a shortcut to making decisions.  I also explore Daniel Wegner’s theory of transactive memory in this column. Finally, I look at how working memory dictates how we digest search results.

Human Hardware: Men and Women

Humans come in two models: men and women. Despite rampant political correctness, there are distinct differences between us (in case you hadn’t noticed). This column looks at some of the cognitive and neurological differences (I tried to keep my comparisons from the neck up) and how it impacts things like shopping, navigating and asking directions, understanding conversations and spending time online. I spend some time outlining gender research differences we’ve seen in past usability studies.

Human Hardware: Dunbar’s Number

In part One of this two part installment, I pose this question: Do we have limits on how many friends we can make? Robin Dunbar, a British anthropologist, believes the answer is yes, and that number is 150, give or take a few. I look at Dunbar’s research and reasoning, and how this limit has impacted human evolution and our creation of social networks. I touch on the evolution of language, the Great Leap in human evolution (why we went from throwing rocks to creating art in what was relatively the blink of an eye) and the importance of grooming as a social glue.

I’m pretty pumped about this series, as it ties directly into my book research, so this has been a way to work out a few of the ideas. To be honest, I have no idea how many installments there will be in the series. Along a similar vein, and in case you missed it, you might enjoy the Google Habit series that ran on MediaPost and earlier in this blog. Just check the archives.

The Last Word on Breaking the Google Habit

First published March 13, 2008 in Mediapost’s Search Insider

When I started this series of columns, I had no intention of making it a series. But now, with the fifth (and final) installment, it looks like I may finally break this particular habit. It’s been fascinating for me. Hopefully it’s been equally interesting for you.

We Develop Strings of Habits

In last week’s column, I talked about environmental cueing and reinforcement. Here, cues in our environment (the ubiquitous toolbar search box, for example) trigger a habit, and the expected outcome (the delivery of relevant results) reinforces the habit. This creates a sustaining cycle.

But there’s one other aspect of habits that we should look at. We tend to develop habits as strings of events. One environment cue might trigger a series of actions. The classic example is those who need a cigarette when they have a drink. Some recent research paints a fairly bleak picture of North American society and shows how obsessed we are with habit-inducing cues. The “why” question poised was why French people were less obese than Americans, despite a diet high in fat. It turns out one major reason why is that Americans let external cues, such as which TV show is on, drive their eating patterns. We always have a bowl of Chunky Chocolate ice cream while we watch “Desperate Housewives.” The French tend to eat when they’re hungry, and stop eating when they’re full. For the French, eating is a joy. For Americans, it’s a habit.

Swimming Upstream

As I mentioned before, to break a habit, you have to intercept before the habitual behavior, rather than try to educate and modify after the fact. And the less thought required to execute the behavior, the harder the habit will be to break. If your habit takes a few seconds to do, the opportunities to intercept and kick in the rational brain are minimal. This provides a distinct challenge to anyone looking to usurp Google’s search crown. Searching is becoming easier than ever.

The competitors have to look at that split second that exists between the awareness of the need for more information and the instinctive move to the nearest search box to launch the query. It’s in that tiny sliver of time that the opportunity to break the Google habit exists.

Searchis Interruptis

So, given the fleeting nature of this opportunity, how do you grab it? One way is to anticipate the need of search before it happens. This is the implicit query work that Microsoft was experimenting with sometime ago. As you work on a task, potential search queries are monitored in the background and are presented to the user. But a constantly shifting window of potential searches would probably drive us all batty.

Another way is to integrate search at an application or OS level, making search even easier and inserting a habit-breaking context switch into that tiny sliver of indecision that exists between awareness and Google.

Attack the Weakest Links

But even integration of search at this level won’t be enough. Remember, we tend to give the advantage to the incumbent. We actively look for reasons to maintain the habit, and we ignore information that runs counter to our habitual choice. Even if a search alternative is one click less to get to, that alternative still has to provide a significant reason to switch. They not only have to beat Google at the game of search, they have to do it in a decisive way. For this reason, a competitor has to attack Google’s user base at the weakest point, the ones that are using Google because it’s handy, not the Google loyalists.

True User-Centricity

This brings us to my last strategy for breaking the Google habit: a truly user-centric search tool.

Up to this point, verticalization in search has taken one of two forms. Either engines have attacked a topic category (i.e. Business.com and B2B, Lawyers.com and legal services, Expedia.com and travel) or a type of content (i.e. Blinkx and Youtube for video, Technorati for blog posts). These approaches tend to be vulnerable because we are creatures of habit. Generally, we prefer to use one place to launch our searches. We’re already using Google for most of our searches, so if it can provide an equivalent experience to these vertical engines, it can quickly assimilate the traffic and squeeze the verticals out.

This is not as easy as it sounds. Google has yet to provide an equivalent experience in most of its verticals, but now that it appears that the default design of the search results page is no longer a sacred cow, I would expect the functionality gap to close quickly.

But what if we took a different approach? What if rather than verticalizing around a topic or content bucket, we verticalized around a type of user? What if we maximized the search experience for millennial males or female baby boomers? The verdict on personalized search seems to be that a one-size-fits-all solution is a long way off on the horizon, but an intermediate step might be to tailor an engine for a segment that shares similar needs and expectations. By focusing on a niche strategy, you might be able to break the Google habit, one segment at a time. In this way, you might be able to provide the discontinuous innovation needed to catch people upstream, before they get swept away with the Google tide.

Human Hardware Series on Search Engine Land

I’m kicking off another series in the Just Behave column on Search Engine Land. I’m calling it the Human Hardware series, and it it I’ll be exploring some of the inherent traits of humans and how they affect our online interactions. In the first installment, last Friday, I looked at working memory, channel capacity and satisficing, area I’ve explored in past posts. Here’s a brief excerpt:

As people start to dive into the human genome, it’s somewhat startling to find the lack of diversity in the human gene pool. As different as we all think we are, we actually are alike in many more ways. We share a remarkable similarity in our physiological and neurological make up. Added to this is the fact that there are several inherent traits we all share, the result of thousands of years of evolutionary tweaking. There are absolutely deviations from the norm, but as a quick glance at any bell curve will tell you, for any given trait or characteristic of humanity, including intelligence, loyalty, physical strength or the ability to juggle, most of us cluster around the center line, otherwise known as the norm. It’s the inherent limits of the vehicle we inhabit, our body.

And lest you start feeling too superior, we actually share 98.4% of our genetic material with chimpanzees, our closest evolutionary relative. There is more genetic diversity between two breeds of dogs than there is between us and the average chimp. In fact, apes and chimpanzees are genetically more divergent than chimps and humans. Try wrapping your mind around that one on your next trip to the zoo.

As we start looking at our success in predicting behavior, the peak of the bell curve for our target population is where we have to start. It helps to understand the human hardware issues, which form the foundation of our understanding of predicted behavior. From here, we can tilt our strategies to accommodate diversions in either direction from the norm.

Why is the human gene pool so shallow? It’s because we all come from the same place, a relatively small population of modern humans in Africa, some 150,000 years ago. Recent research has shown that genetic diversity lessens as we get further and further from Africa. And one particularly interesting study speculates that all blue eyed people come from the same common ancestor. Our family tree has remarkably few branches if you go back far enough.

The rest of the column can be read over at Search Engine Land. Next week I’ll be running Part Two, looking at the differences of men and women.

More on Why Google is Habit-Forming

First published February 21, 2008 in Mediapost’s Search Insider

In last week’s Search Insider, I introduced the idea of habits, and why they can be hard things to break. This week, I want to explore how search engines can be habit-forming as well.

Cognitive Lock-In

Habits form and stay formed because there is usually a cost associated with discontinuing the habit. In a commercial interaction, this is referred to as the “cost of switching.” These are the lock-in mechanisms that companies hope will keep you from walking across the street to their competitors. In theory, the cost of switching on the Internet should be negligible, creating a frictionless, “perfect” market. There’s no financial penalty. The Internet erases geographic boundaries. And this should be especially true in search. After all, other search engines are only a click away. But researchers (Johnson, Bellman and Lohse, 2003; Brynjolfsson and Smith, 2000) actually found the opposite to be true. It seemed that customer stickiness can actually be greater online. So, if it’s so easy to switch, why aren’t more people doing it?

It appears, based on research (Zauberman, 2003), that there’s another cost of switching, the cost of learning new interfaces. This has been called “cognitive lock-in.”. As you become comfortable navigating through a site, the cognitive cost of learning new interfaces tends to build your loyalty and keep you “locked in” to the site. This happens in the real world as well, and could explain my wife’s seemingly irrational loyalty to the bad grocery store I described last week. She knows where everything is. She knows where to park. And she knows who to argue with when products don’t meet her standards (as well as how to get her point across — it’s an Italian thing). It may not be great, but it’s familiar!

Will Differentiation Increase the Power of Lock-In?

A recent study (Murray and Haubl, 2007) found that cognitive lock-in comes from habits of use as well as habitual choice. Both are relevant in the search space, but let’s put habitual choice aside for a moment. Habits of use form when we become familiar with using a product, the actual mechanics of how it fits us in realizing our goals. We know how to use Google, for example, and how to refine it to get the results we’re looking for. We know which links take us where, which tabs to hit and even through we never use it, the “Feeling Lucky?” button reminds us we’re on Google. When Google tried to remove it, based on lack of usage, there was a huge user backlash.

This sense of familiarity meant that until recently, all search engines looked the same. The same ten blue links, the same treatment of sponsored ads, the same basic layout. But in a recent set of interviews with all the major engines’ design and usability teams, it was made clear that we can expect more differentiation among the engines. Ask’s departure was just the first step in this movement.

It’s Not Just a Tool, It’s a Badge

But it’s not just the utility of an engine that increases lock-in. There’s also habitual choice. This comes from our lock-in to a brand. We always drink Coke, we always drive a Honda, we always fly Southwest, we always search on Google. Yes, even something as utilitarian as a search engine engenders brand allegiance. We identify with brands because they help define us as individuals. And this has happened to varying extents in the search space.

There Will Never Be Another Google in Search

You might ask, if Google became a habit, what’s to stop another engine from also becoming a habit? Well, first of all, it won’t be nearly as easy for a new player as it was for Google. Think back to when you first used Google. No one engine had established itself as the user’s choice, creating the “lock-in” effect. I used to hop back and forth between four or five engines, depending on my objective and the closest engine at hand. I’d perhaps start at Infoseek or AltaVista, and if I didn’t get a great result (which was pretty much always true) I’d try Excite or HotBot. Then, finally, in desperation, I’d sort through the hierarchal jungle that was Yahoo. No engine had become a habit.

Google’s genius was in providing pretty good results for a wide variety of searchers. Suddenly, I didn’t have to hop from engine to engine, because nine out of 10 times Google provided better results. By the time the rest of the engines had closed the gap, I was already locked in. Now, arguably, other engines provide better results for certain types of searches. But Google is habitual. It’s going to be an uphill battle for the competition. In fact, Google is such a habit; its name has even replaced the word “search.” We now “Google” it.

So, where does that leave the competition? I have some ideas, but they’ll have to wait till next week.

Interview: Branton Kenton-Dau of VortexDNA

In this week’s Just Behave Column, I had the opportunity to interview Branton Kenton-Dau from Vortex DNA. I’ve posted the complete transcript here for those that are interested:

Gord: 
So I think what we’ll do in this interview is cover off on a basic level what VortexDNA does, and then we’ll get into a little bit more about the potential I think it has for users.  So, it’s obviously an interesting idea using core values to try to determine intent. Maybe I’ll let you just walk through a little bit about how VortexDNA works, and why your approach is unique.

Branton Kenton-Dau: 
Yeah, thanks Gordon. I think that is a great place for us to start, and I think for us, it probably would go back to the human genome project itself, where we initiated as a society this project to map our human DNA.  And the great vision around that was that once we knew what our physical DNA was like we would be able to define the characteristics of your world and in particular help prevent  serious illnesses.  And one the outcomes of that project, was actually we found that there weren’t enough genes.  We found too few genes to map the 100,000 chemical pathways of our body; and that since then, where science is taken us is that it’s demonstrated that our physical DNA actually doesn’t determine who we are, but the whole science of epigenetics is saying actually it’s our environment, you know what we eat and particularly what we believe about ourselves which determines our propensity to be ill, to be healthy, to be successful or not.  So, actually our belief system is a major impact in determining who we are, and what is exciting about that is basically it represents a shift for us as a society from the very deterministic view of ourselves; that we are basically physical machines. Either we’re broken or not, depending on what our parents gave us, to the idea that we are actually beings that are creating our own lives with much more build out of what we  believe about ourselves at any moment and any time. That’s exciting because what we believe about ourselves can obviously be changed.  And basically what VortexDNA is is a technology that came out of the insight that the way we structure our beliefs is governed by the mathematics of complex systems.  What that means is that we know the structure our beliefs, and because of that we can then map out the structure of our intentional DNA, the intentions behind the world we create, and that’s basically the breakthrough, the technology. It provides a map of the way people organize who they are, literally who they are, through their belief systems.  And out of that, then comes the opportunity to create a better world for yourself whether that’s finding your best life partner or finding better research results or finding better car insurance rates because your particular belief system has a low propensity for accidents. It actually touches every part of your life, because we are actually mapping human characteristics.  The true genome, if you like, based upon the new science.

Gord: 
Okay, this is an interesting approach and undoubtedly a unique approach. I don’t know anyone else who is doing this. But you know, I approach this with a fair degree of cynicism saying, okay, obviously if you learn more about my belief system you can try to map that against the content of the internet. But how well does that actually work because my beliefs are the foundation, but on top of that, there are a lot of layers of intent for a lot of different things. How granular can your belief system be in disambiguating intent?  In some searches, I would see it working very well where it points to sites that you know resonates with my belief frame work, but in others where it is a much more practical “looking for information”, will trying to anticipate with my beliefs might indicate would be a good site, will that really be a good indicator of relevance?

Branton Kenton-Dau: 
That’s a really good question Gordon; I think that the answer to that is that we don’t know yet.  I think that we are at very early stages of really what is the science of human intention, I mean, that’s really what’s it about.  And what I can share with you is that we validated the technology last year against Google search results, and that’s where we were able to show that we can improve Google’s page rank by up to 14% which would improve it by a 3% improvement in click rates.  And, what that seems to be saying to us is (it does help), and that’s across the board, people obviously searching for anything and everything that’s possible on the web, we were analyzing that data.  We haven’t been able break that down to say whether or not if you’re hunting for a job, we are able to provide better recommendations than when you are looking for your recipe for custard or something; we just don’t know yet enough about it.  One of the things is interesting is that when we had our expert review done on that data by a Rhode Island consultancy firm, they said that they the way that the technology works, because it’s iterative, i.e. it learns as it goes.  He said that we probably have no idea yet of how efficient the system is, we don’t know because we are dealing with a very small sample and as more and more users and more DNA is selected on links of the net, then there is no reason that it can’t actually be more effective than we’ve demonstrated, but we just don’t know yet.  It’s just early days yet.

Gord: 
You made the comment that this is iterative and it learns as it goes, and from going through your site I see you answer an initial questionnaire; and I’ll get to the whole privacy question, or the perception of privacy question is probably more accurate, I’ll get to that in a minute. But you answer the questionnaire that creates an ideological or a value-based profile of you which then gets mapped against different sites.  But then, at anytime you can go back and answer more surveys to further refine what that profile looks like.  How much of this refinement process or this learning process is incumbent on the user as opposed to transparent in the background just by VortexDNA watching what are you doing and how you are interacting with different sites?

Branton Kenton-Dau: 
The answer is this system actually learns that every time you click on something, because every time you click on something, if you have downloaded the extension, the MyWebDNA extension, basically every time you click somewhere it’s a statement of your intentionality, so if other people have also clicked on it, it helps build up a map for that link of the intentionality that has been focused on the link.  So, we can feedback that intentionality into your own profile and therefore you don’t have to do anything.  Actually this year we will probably do away with the survey, so then you will won’t even need the survey to get started, that was just like a pre-heat process.  So, all we have to do is just surf as normal and you will be monitoring the state of your intentionality moment by moment with each click you make.

Gord: 
Okay, so let’s deal with that a little bit.  If you are monitoring my activity, in some ways this overlaps with what Google is doing with their web history and their search history, where they are tracking your usage and trying to learn more about you as an individual, theoretically, and then altering the results on the fly based on the personal signals it’s picking up. What you are doing is you are layering this outline of core values and what our belief systems are over and above that to say, “Okay well, not only are we watching what you are doing; we are trying to understand what’s important to you as an individual.”  Now, if we take that and we say, Okay I am in a business where at any given time for any given hour I’m working, I may be doing research, I might be writing the column on hate literature in North America, so I am going to be going to the sites of Neo-Nazi groups, trying to find information..that’s just part of my job.  How do you know that that doesn’t reflect my belief system, how do you know that this is just something that I happen to need to find information on right now?

Branton Kenton-Dau: 
There are two parts to that.  One is that I feel we are very respectful of what Google and Yahoo, and their analysis in the whole semantic web push are doing in terms of trying to make the web more relevant to people and we do believe our technology is complementary to those approaches.  We don’t believe we are competing with any of those and, as you say, it’s overlay, it’s additive to those.  Having said that, we are really completely different to that because, it’s actually the structure, the pattern, the way your beliefs are organized that we are interested in, and what that means is that we actually turn your answers to your questionnaire, what you click on, into just a set of numbers.  There are seven numbers that correspond to different aspects of that pattern of organization, that makes up your intentionality.  And so, really when you are going around, what we are doing is as you click on something, we will compare your number, it might be 7632416 say, with the numbers that are held against that link.  So, what we are doing is we are comparing numbers, we don’t know whether you’ve gone to a Nazi site or whether you are looking for apple pie recipes. We have absolutely no idea and maintain no record of where you’ve been, in all those sites. So when your genome is updated, because you’ve gone to this site,  we might update your genome because you’ve been to that site to change one of your digits in one way, by one point or so, then that digit could be changed from any site you ;  the news or Yahoo! or whatever.  So, what makes us really truly unique with this approach, which we think is really important, is that we absolutely protect your privacy because we do not track your searches in any shape or form because we are just adding or subtracting numbers from that seven digit identifier.  So it makes no difference to us, and I think that’s a really powerful thing, because you know there is concern with people for what information people hold on them and all we hold is a seven digit number, and you could be anywhere, it could have been Walt Disney Movies, it could have been finding out about the players in your favorite football team, it makes no difference to us.  So we can’t tell even if a law enforcement agencies came to us, and asked to us, “hey, where has Gord been”, we would have no idea, we could not tell them.

Gord: 
So what you do is in your identification of all the sites, you look at the sites and you assign each of those a profile and then your profile is altered on the fly based on the profiles you are matching up with against your content then, right?

Branton Kenton-Dau:  That’s correct and they’re all number, those profiles are numbers so…

Gordon: 
Right.  So there is no history retained, it’s just a constantly updated value which in turn, with every time you go out, is compared against all the values of the sites that come up in a search engine for instance, and the best possible matches are highlighted in the search results then.

Branton Kenton-Dau: 
Thank you, that’s absolutely perfect.

Gord: 
That’s interesting.  And now, obviously, that’s a totally different approach and one that should put some fears to rest on the privacy side, but I’ve got to tell you when I checked out VortexDNA and went through the process of the download, the whole idea of filling out a  questionnaire identifying my belief system, it gave me cause for concern. It was funny because as far as identifying me as an individual, the demographic information I fill out here and there across the web is potentially much more of a cause for concern for my privacy, because there is identifiable information in there.  I don’t usually have a second thought about but something about putting my beliefs down and sharing them with somebody else was very hard for me to do. Are you finding..and you said that you are probably going to drop the questionnaire…but are you finding that as a sticking point for people signing up for VortexDNA?

Branton Kenton-Dau: 
I think some people never think about it.  We get up in the morning, brush our teeth and go to work and make our daily bread.  Sometimes we don’t have time to think at all, “why am I here?”, and when you ask the question, “what’s your purpose in life?” Well that’s a pretty profound question.  What we found is that some people don’t fill in (the questionnaire) correctly or too quickly or they just answer anything, they don’t really think about it deeply and therefore, because noise goes in, they just get noise out.  That’s where over the course of last year we actually developed what we call this idealized genome. We can just infer your genome by what you click on.  We think that’s a much better way, and we can do that for instance, by just playing a game.  We can show some images, pick some of your favorites, we can infer your genome that way.  So, lot’s of more, less mentally taxing and more fun ways that we can get you started in creating your genome, your profile, which we think would work a lot better.

Gord: 
Well, you mentioned this whole approach may limit your potential market just because a lot of people haven’t thought about what their core values are or what their beliefs are, so the whole appeal of VortexDNA might be lost on them.  Unless you are a fan of Stephen Covey or you’ve read Built to Last, or Good to Great, you may not get it.  What are your thoughts about that?

Branton Kenton-Dau: 
I think you are right, and I think that the technology is broad enough, so it can serve anyone, whatever their focus is in life, and that it’s our responsibility to make sure that it’s that easy to use. We like to be able to do it (transparently), say, if you want to play Pacman, this way you are building up your profiles, and we can enable you to do that.  And we should be able to that shortly.  At the same time, I think one of the really key things about the technology, and certainly from my point of view of what, you know, gets me up in morning is the fact that I think it really is empowering for people to understand that the lives that they create, they literally do create it, it’s not given to them. Who you are is not determined by your upbringing, or your life experiences, or by the genes your parents gave you; but it is actually created by you moment by moment.  And, it’s my hope that the technology would help. It’s really a very American thing, in the sense that there is all about human freedom ultimately, and it gives people more freedom as they realize, “well, I am the creator of my life and if I am going to keep stuck in this rut then it is what I believe about myself that is keeping me there.”  That’s what I find exciting about the technology, so I hope that may dawn on some people faster than others and that’s okay, there is no problem with that.  But I believe the technology has the ability to make a contribution to human freedom ultimately.

Gord: 
So, you are climbing up Maslow’s hierarchy to the top level?

Branton Kenton-Dau: 
Yes, I absolutely believe that and I think that  we as human beings are always trying to really understand our true ability to create reality, and that our intentionality is, if you like, part of ourselves that we probably put less effort into training than anything else.  We spend a lot of time on the fitness machines or jogging to keep our bodies in shape, but we haven’t spent a lot of time in what actually seems to be a real key factor in determining the success of our life, which is our intentionality; and so I am hoping the technology will help focus us on that.

Gord: 
We’ve talked about some pretty lofty ideals for a technology here. About  helping people with self-actualization, and become better people, and become more aware of both what’s important to them internally and externally.  All of which is great for any fans of Collins or Covey who might be reading this or listening to this. We are getting to the hedgehog concept here; you are obviously passionate about this, you’ve got something different that you can be unique in, possibly best in the world at.  Now, comes the money question. How does this drive your economic engine? What’s the business model for VortexDNA, and how do you see that playing out over the 2 years to 3 years?

Branton Kenton-Dau
We have given a lot of thought about that and made a lot of mistakes as well and I think U-turns on it.  But basically, the company I represent, we basically have a technology which we issue licenses to other organizations and participate with them as strategic partners. For instance, in rolling out the technology.  And there are two kind of key parts for that, two key aspects of the technology, one is that the technology can be used by any ecommerce sites, whether that’s an e-tail or social site, in order to provide better recommendations, using their algorithms.  So, that’s a pure B2B solution, and we have the company incorporated in United States at the moment in order to do that. We would be interested in anyone who would like to partner with us to roll that out.  And then, the other side is that we feel we can create a better web by harnessing the power of mass collaboration, just like Wikipedia, to map the genome of the web and out of that, will come better search engines, will come a better ability to find people like you anywhere you are, enhance your blog, pretty much a holistic upgrade if you like, of the web itself. And that, we believe, like search engines themselves, is a pure advertising based free service to users.  So, we see there is an application there and in fact within next 30 days, we will be launching the Web Genome Project with its own website, and that would be an advertising based play again.  We believe that that has potential in every country in the world and we are open to issue licenses to partners that would like to take up the opportunity.

Gord: 
This territory has been somewhat explored in the past, you know the one example I am thinking of with the Music Genome Project where Pandora tried to use your past songs you like to recommend more songs you might like.  So, is this somewhat similar to that except obviously a much broader scope. Anything that could be on the web, right?
Branton Kenton-Dau:  That’s correct, I guess the difference would be that what’s great about the Web Genome Project is that while you sleep, millions of other people will be clicking on things that will make the web better for you in the morning.

Gord: 
Right.

Branton Kenton-Dau: 
That’s what’s so cool about mass collaboration. You do your clicking, you click on whatever, a thousand links in your day, but while you are sleeping well there are millions of links that have been updated and have better DNA against them, so that you can find what you want better when you wake up in the morning, and that’s really exciting.
Gord:  It’s definitely one of those big idea things.

Branton Kenton-Dau
Yes.

Gord
To flip this on its side, as a community we are all clicking away, and this DNA matching is going, so it’s making the web a better place, as you say, collaboratively, but on the flip side of that, once you’ve identified or a profile has been built that’s been refined over time based on the sites you found interesting or you’ve spent time with.  That’s a unique identifier that says something about you so, theoretically, down the road, if somebody comes to a site, if the owner of that site can identify what’s important to that person based on the profile, it could on the fly serve up content matching those beliefs, is that another possible application for this?

Branton Kenton-Dau: 
Thank you, that’s what I was attempting to describe in the first application, that’s the B2B solution.   So an e-tailer or search engine can now take out a license to run the application, the user would visit the site, you won’t see anything different through your Google search or through your Amazon book recommendations, but that’s all being added to the recommendation engine behind, so you are just going to say “hey, for some reason, I just feel that I am getting better recommendations now”.  So, it’s our way of making the web more efficient and that technology is available right now. We’ve got three installations in United States currently progressing, and that’s the other, that’s the business-to-business model, and we believe that has applications around the world as well.

Gord: 
So, for any business applications the big question is critical mass, how many people will be downloading the plug in and using it?  This is fairly new, how long has the Firefox plug-in been available?

Branton Kenton-Dau: 
About a year now.

Gord: 
What has the adoption been like to this point?

Branton Kenton-Dau: 
At this point, it’s been slow because what we’ve actually done is that plug-in was actually built initially to validate the technology.  That’s what we had to do last year, and then we spent the rest of last year really building enterprise-grade technology that enabled to be used by clients. So we really start the year, as I said, the next 30 days will see the Web Genome Project being launched, so we are only just at the start of the technology coming online.

Gordon: 
Are there any plans to accelerate the adoption either through partnerships or bundling or other ways to actually get people to download the plug in and start using it?

Branton Kenton-Dau: 
There are, I mean for each of the people, partners, e-tailors that would like to use the technology, we’ll be producing custom versions with extensions for their users, so that, they will encourage their uses to download the extension, because that will help map the DNA of their links quicker.  So, that will speed the application and we have also got plans to provide custom versions of the extension also to people of different social networks, so that they can enhance the experience within social networks as well.  And then, also if you’re logged in to any service, if you have an account with Amazon or some other e-tailer, you actually don’t need to use the plug in because when you login they already know who you are, so you already will be able to get better recommendations from that person without using the plug-in at all. You won’t see it. It would be completely seamless and invisible to you, and you just get a better web experience.

Gord: 
So, if you log into Amazon for instance, I guess it just keeps the profile so that profile would not be portable then.  It would stay with Amazon, and I think to get to the broader context of what you are talking about, the portability of that profile, the fact that it goes with you from site to site, would be an important part of that, right?

Branton Kenton-Dau: 
That’s why we see the extension would be great if people did use it or it just became embedded in web browsers generally.  Because it will give you a more universal better experience. 

Gord: 
Okay so looking forward, you’ve done a lot of development on the backend to build the infrastructure, and the theory is there.  Now, it’s just a matter of having it proven out in real world situations, right?

Branton Kenton-Dau: 
That’s exactly what we are about to see. That’s why these installations are taking place at the moment in the United States to validate that, and we are getting started with the Web Genome Project, it is all about delivery this year.

Gord: 
Well, it’s fascinating, like I said it’s one of those big idea things that is fascinating to contemplate.  Is there anything else you wanted to add before we wrapped up the interview?

Branton Kenton-Dau: 
We’ve worked on this  pretty much, well, it’s been an 8-year project, so it’s not been a fast thing for us, but I just thought I might share  a couple of books that have been really important to me which you probably know about anyway. One of them that I just finished reading is The Intention Experiment by Lynne McTaggart who is also the author of The Field. What is nice about that is she just documents all the rigorous science that is basically saying that we are shifting our paradigm, to understand we are more like any energy fields, if you like, than physical bodies, that’s the definition of us.  And just the science has come out of Stanford and other places that validates that, is just awe inspiring.  And then, the other one is The Biology of Belief by Bruce Lipton, which gives that whole transition process from us believing we are physical genes to the whole science of extra genetics, if it’s actually our environment including our beliefs which is a key factor in determining who we are; and I just wanted to share those because I found those two books very inspiring.  They happened after the fact. We didn’t build the technologies because we read the books, but with the books now, we say “oh yeah, that’s why our technology works.

Gord: 
Well, it’s interesting you mentioned that because it seems like anytime I ‘m talking to people about really interesting things there has been this almost renaissance of understanding about what makes us as humans tick, starting in areas like psychology, neurology, and evolutionary psychology and a whole bunch of different areas.  And it all started to happen in the early 90’s, and just for the last 10 years to 15 years, it seems like so many paradigms have shifted.  We’re just looking at things in a whole new way and I agree with you, it’s very inspiring and exciting to know that everything seems to be in such flux right now.

Branton Kenton-Dau: 
I absolutely agree with that, and that’s been our sense as well.  It’s just such a privilege to be part of that process.  I know your comments and what you are doing is aligned with that as well.  You know, we are all doing it, but when we are creating together, we are creating something which is new and exciting, I think, and we all have our parts to play in it.  I find it a privilege to participate in this, really, it’s human movement in taking us forward at such a rapid pace as well, so we are now absolutely aligned with what you were saying there.