Why Google is Habit Forming

First published February 14, 2008 in Mediapost’s Search Insider

My wife Jill was the victim of another drive-by “why-ing” — and I, of course, was the perpetrator.

There’s a small specialty grocery store where we live that Jill visits every week or two. And almost every time, she complains about the experience. Outdated stock is repackaged. Food is rancid. The staff is surly. But she keeps buying there. After listening to another long-winded vent, I dared to go where no man should go. I asked her “why?”

There were a number of reasons that she gave. It’s on the way on her daily route. Parking is convenient. Prices are low. But the biggest reason was one she didn’t express, because she didn’t know it. It had become a habit. And habits are tough things to break.

Why We Have Habits

Like almost everything else, habits are a way we cope with the world. They’re cognitive shortcuts so we can save our brains for more appropriate work. And most times, they work pretty well. When things work the same way the majority of times, we don’t have to think about them every single time. We relegate them to habits. It’s why we have such difficult times with doorknobs, even when we’re given instructions (“push” or “pull” –and thanks to SI reader Peter Simmons for the example). Our brain is in short-cut mode, so it’s not taking the time to read signs. Based on the shape of the door handle, the presence or absence of push plates, whether we’re entering or exiting and other cues, the brain makes a decision to push or pull without really consulting our conscious mind. We won’t even see the sign (which would engage our consciousness) unless we don’t get the result we expect.

Habits are grooves worn in the brain, and they tend to be relatively durable because of that. The rule of thumb seems to be about three weeks. So, if you moved a light switch from the right side of the door to the left side, it would take about 21 days before your brain stopped telling your right hand to turn on the switch.

The Hand is Quicker Than the Brain

Here’s the important part of that circuit (the one in the brain, not the one that turns on the light). The loop between the brain and the right hand is an unconscious one. It’s made of synapses firing on autopilot. At a conscious level, you know the switch is on the left side, but the conscious loop is slower than the unconscious one. It’s the laziness of the brain at work. If we don’t have to think about everything, why should we? So your right hand is already patting the wall looking for the switch before your rational, thinking brain catches up and says, “It’s on the other side, idiot.” This has to happen a couple dozen times before the new groove in your brain is established and you can go back to not thinking about turning on the light switch.

Why Incumbents Usually Win

Now, in my typical, roundabout way, I am getting to why this is important in search. If we think about habits, it starts to become clear why Google has such a huge market share advantage. I’d like to introduce another idea called the “incumbency effect.”   When it refers to politics, the incumbency effect means that once you win an election, you have a greater chance of winning subsequent elections for the same office. This is due to several factors that give you the edge in the eyes of voters: familiarity, experience in the role, access to funding and the ability to call in favors racked up during the previous term. All things being equal, incumbents are tough to beat.

But in other arenas outside politics, the incumbency effect can also be driven by the fact that habits are formed. It’s not just the rational reasons why an incumbent can be tough to dethrone; it’s also the irrational ones. The incumbent has worn a groove in our brain. And to knock off an incumbent, with all these things in their favor, you can’t just be a slightly better alternative. You have to be significantly more attractive. Either the incumbent has to screw up badly, or you have to offer a dramatic improvement over them.

As per usual, my weekly allotment of words has run out before my idea, so I’ll pick this up next week, when we look at the incumbency effect and a parallel concept, cognitive lock in, and how they’re playing out in the world of search.

More on Search, Transactive Memory and the Elastic Mind

First published January 31, 2008 in Mediapost’s Search Insider

Thomas Young was the last person who knew everything. Or, at least, that’s Andrew Robinson’s claim in his book of the same title. Whether you agree or not, the accomplishments of this 19th century Quaker were certainly impressive. In contradiction to Newton, he proposed the wave theory of light, furthered our understanding of the mechanics of the eye, helped invent Egyptology and decipher the Rosetta stone, created a measure of elasticity in engineering, was an accomplished physician, created a technique for tuning keyboard instruments, compared 400 languages, coined the term Indo-European and still had time to pioneer developments in carpentry and life insurance. Thomas Young was the human Google of his age.

Today, our world is much more complex. There’s too much knowledge to store in just one mind. So, we tend to find other places to keep it for when we need it. Hence the concept of transactive memory, which I touched on last week.

Misty, Watercolored Memories

We have different methods for storing different types of memories. The way we remember our 21st birthday (if we still remember it at all) is different than the way we remember our phone number. Then there’s the way we remember how to ride a bike, or what Led Zeppelin’s “Black Dog” sounds like.

And some people are better at remembering certain types of things than others. That’s why we’ve adapted to extend our memory capabilities by using transactive memory. We rely on others to store memories that we might need at some point. Our wives remember birthdays. Our kids remember how to program our smart phone. Our co-worker remembers how to run the virus scan on our computer. We don’t have to remember all these things; all we have to remember is who does.

The Transactive Web

But what about computers, and, by extension, the Internet? What about search? Doesn’t this take transactive memory to a level never thought of before? Even the reduced work load of remembering who remembers what is significantly more trouble than just being able to instantly recall information with a well-placed query. We dump the details of our life on a hard drive somewhere, and search for it when we need it. Even if we’re looking for something we didn’t know we needed, like the recipe for haggis (how many of you celebrated Robbie Burns Day last Friday?) we can find it when we needed it. And we don’t have to remember it, because we know it will be there come next Jan. 25.

The Adaptive Brain

And that brings us to the second point I raised last week, that of neurological plasticity. Our brain prunes itself, getting rid of capacities we really don’t need anymore, and strengthening those that we do. This happens to the greatest extent in the first few decades of our lives, but it is a lifelong process. I am forcibly reminded of this when my 14-year-old daughter asks me for help with her algebra homework. At one point in my life, I knew this stuff. But most of those neurons have long since disappeared. To offer any help at all, I have to relearn what I once knew, building new neural pathways.

So, as we have to worry less about remembering certain things, like facts, dates, phone numbers and addresses, will our semantic memory capabilities, the place we store these things, become less exercised and therefore, pruned out of the way? And in its place, will we develop greater skills in navigating online spaces?

It’s really not a question, it’s already happening. We can see the difference in the generational abilities in the online space, or when our kids kick our virtual butts in a Wii showdown. But we’re still in a place where we’re balanced on the cusp between the pre- and post-digital world. We still have a foot in each realm. Let’s fast-forward a generation or two and see which capabilities that seem so essential to us today have disappeared. And which new talents, unfathomable to us today, have taken their place.

Exponential Technological Advances

Now, obviously, this is nothing new. We don’t need to remember how to shoe a horse, and our great-grandfather would be amazed (and possibly aghast) at a trip on a California freeway. Change has always happened, and humans have always adapted. But there’s something different now. Raymond Kurzweil calls it The Law of Accelerating Returns. The need to adapt to leaping technological advance is getting more and more demanding. Technological growth is exponential. At today’s rate, we experience 20,000 years of progress in a century. In the year 2045, Kurzweil believes we’ll hit a point where machines become smarter than humans. Could the human mind, which is amazing in its adaptability, simply be outstripped by technology?

One last thought. If you believe in evolution (as I do) humans have evolved as the preeminent species through a long line of trial and error, with our environment as the ultimate judge of genetic worthiness. The problem is that evolution is a long, slow process. Our evolutionary environment, the one we’ve adapted to excel in, is a hunter-gatherer society several thousand years past. Evolution never equipped us to function in the world we live in, except in one regard. It equipped us with an adaptable mind that allows self-awareness. And even that is inextricably tied to our human nature. The human mind is a wonderful thing, but unfortunately, it doesn’t benefit from Moore’s Law.

Search, Transactive Memory and the Plastic Mind

First published January 24, 2008 in Mediapost’s Search Insider

In 1986, University of Virginia Psychologist Daniel Wegner came up with an interesting theory. He realized that we depend on others to remember some of the things we need to know. This is especially true in couples and families. Some of us are better at remembering phone numbers and birth dates. Some of us are better at remembering how 401Ks and computers work. In couples, the longer we spend together, the more we divvy up the memory workload, depending on our spouse to prop up our spotty memories.

Wegner called this transactive memory. With it, we don’t have to remember everything. We just have to remember who knows what. Wegner found this to be true in any small group who spends a lot of time together. The bigger the group, the larger the extended memory capacity.

That’s the first concept I want you to think about. Now, let me give you another.

It’s the Second Chimp on the Left, the One with the Scar

Babies are born with a capability that you and I don’t have. They can recognize and distinguish between faces of different species. For example, if you introduce a 6-month-old baby to six different chimpanzees, then show them pictures of the chimp faces, they’ll be able to recognize them and tell them apart. But to us, they will all look like chimpanzees. The same is true of sheep, or lemurs. To us, a sheep is a sheep is a sheep. It seems we lose this ability around 9 months of age, according to Olivier Pascalis at the University of Sheffield.

Why can we no longer tell chimpanzees apart? We’re born with this ability because at one point in our evolution it was important. The ability to tell animals apart led to a greater chance of survival. But that’s not really true today. Today, in our complex social world, it’s much more important to be able to tell human faces apart. So at about 9 months of age, the brain starts to concentrate on that. And, in this case, something has to give. Sorry chimps, but after a while, you’ll all look the same to us.

There’s one more point I want to share here. Dr. Pascalis found that if parents continued to develop their babies’ ability to distinguish between non-human faces by repeating the exercise, the babies retained that skill.

The Pruning of the Young Mind

It’s not so much this lost ability I find interesting. It’s the underlying reason, the ability for the brain to change itself from birth to maturity. Humans received another gift in the evolutionary lottery, an adaptable mind. The brain you get at birth is not the brain you’ll end up with. A 2007 study at Oxford University found that newborn brains have almost 50% more neurons than adult brains. Babies have more raw “brain material” to work with. They get shipped with the full menu of evolutionary options, including the ability to tell monkeys apart.

But over time, in a process known as “pruning,” the brain starts to discard options it doesn’t use very often. Weak, underutilized neurons, forming neural pathways we never use, get pruned and, in some cases, reconfigured, to make way for pathways that are more commonly used. To go back to our facial recognition example, being able to keep track of all the faces in one’s ever increasing circle of friends and family is a huge task. And it’s right around 9 months that we start venturing out in the world, meeting more and more people. The timing of this is not coincidental.

Fertilized Neurons

But our brains not only get rid of unused functions. They also nurture commonly used functions. The same Oxford study found that although our neuron inventory decreases, we actually gain significantly in another type of cell — glials. Glials are the most important brain cell you’ve probably never heard of. They act as a support system for our neurons, nurturing them and making them more effective. And adults apparently have three times the number of glial cells found in infants.

So, for the next seven days, until my next column, I want you to think about those two concepts: we rely on external sources to extend our memory, and our brains are adaptable, able to rewire themselves to discard capabilities that are no longer important to us, and build capabilities that are more important.

See where I’m going with this? Until next week…

SpaceTime: Another Dimension to Search

The quote on the home page of SpaceTime is intriguing:

“I think I’ve found a product that makes the Google interface look like it was designed by Apple.”
Rob Enderle, Enderle Group.

Now, those are two pretty big names to throw around. But you know what? Based on an initial test drive, SpaceTime just might be up to the challenge. This is a paradigm shift in browsing behavior. When I interviewed Jakob Nielsen last summer, he took Ask to task for calling their interface 3D.

Gord: Like Ask is experimenting with right now with their 3D search. They’re actually breaking it up into 3 columns, and using the right rail and the left rail to show non-web based results.
Jakob: Exactly, except I really want to say that it’s 2 dimensional, it’s not 3 dimensional.
Gord: But that’s what they’re calling it.
Jakob: Yes I know, but that’s a stupid word. I don’t want to give them any credit for that. It’s 2 dimensional. It’s evolutionary in the sense that search results have been 1 dimensional, which is linear, just scroll down the page, and so potentially 2 dimensional (they can call it three but it is two) that is the big step.
Well, SpaceTime attempts to jump the gap to the 3rd dimension by giving web browsing depth as well as heighth and width. Is it successful? Yes and no. But there’s enough “yes” here to significantly change your browsing experience, especially when it comes to searching, and to entice you with what the possibilities might be.

spacetimeopensm

(I tried to get more screenshots, but SpaceTime is a bit of a memory hog, and I didn’t have enough to run SnagIt and SpaceTime as the same time without them both crashing)
Lately I’ve been spending a lot of time writing and talking about how search helps us make decisions where we have to gather and compare alternatives, as in researching an upcoming purchase. This is called satisficing, and search is built to be a natural extension of our working memory. But one of the drawbacks is searches fairly rigid interface. We can usually only see one page at a time. Even the introduction of tabbed browsing, while a step in the right direction, still feels rigid and linear. We pogostick back and forth between pages and the search results. And as I’ve said before, linear is not how humans operate. We’re used to dealing in random ways in 3 dimensional environments. The 20th century squeezed us into a linear, 2 dimension, sequential mode, just because we didn’t have any choice, but the 21st century will be one of navigating within 3 dimensions (and probably 4, as technology allows us the shift timelines to suit our purposes more often) and picking our own random paths through them, berry picking our content. SpaceTime (notice the inclusion of the 4 dimensions in the name) is an interface built to allow this to happen.
Don’t Worry, Be Crappy
Guy Kawasaki always says, when you have something revolutionary, don’t worry, ship it even if it’s crappy. It worked for the Mac. Let’s hope it works for SpaceTime.
Now, to be fair, the SpaceTime interface is far from crappy, it’s a prettty polished piece of work. But if we’re moving into a 3d environment, I want to be able to interact with it in an intuitive way. SpaceTime doesn’t quite allow me to do this yet. I can’t grab and manipulate items in the 3d space. I have to use the buttons and controls SpaceTime provides to go from page to page. But the advantages SpaceTime offers, allowing me to quickly flip from page to page, all the time keeping a visual history of my browsing in a bottom timeline, more than makes up for the pain. This turns pogo sticking into an experience more like spreading options on a table in front of you, allowing you to spot the things that appear to be what you’re looking for. And that’s a big shift from what we’re used to.
In the test drive, I also found that auto loading videos and other rich streaming media seemed to give the SpaceTime interface some hiccups (interrupting the SpaceTime continuum — sorry, couldn’t resist) but I’m sure that’s being worked on. This is version 1.0, after all. Generally, it performed pretty well. In fact, one of my favorite uses was browsing through videos in SpaceTime.
But if we look forward into where things are going, with multitouch displays and surface computing, SpaceTime is the step that’s needed into a much more natural user experience. I’m sure the grab and manipulate options I’m looking for are just a version or two away, waiting for more access to the underlying OS to integrate these features in. But Microsoft or Apple has to let this happen. In fact, once you get used to operating in SpaceTime, going back to 2 dimensions just seems clunky. I’d be amazed if one of the two doesn’t snap SpaceTime up soon. Of course, it could also be that SpaceTime just got out first and there’s something in the Apple or MS labs very similar. I’d love to see a mobile version of SpaceTime on the iPhone!
And this is the cloud on SpaceTime’s horizon. While it’s revolutionary, it can’t survive as a stand alone app. This is something screaming to be incorporated into our online experience, and much as I like it, I probably won’t use it again. It’s great for searching, but rather pointless for standard browsing. Where it shines is when you need to consider a number of alternatives, as in search. It’ll linger at the bottom of my programs list, out of sight and out of mind.  I’m too used to my current browsing experience, and the paradigm shift required to use it as my new browser is too great. Without being adopted by a major player, the proverbial 800 pound gorilla, TimeSpace may die on the far side of the Chasm. And that would be too bad, because SpaceTime is all kinds of cool. Let’s hope either it shows up on a MS or Mac interface, or finds a niche it can survive in. Perhaps it’s the next Google acquisition.
Check out SpaceTime. Just one word of advice for them. Dump the autoplay video. It irritates the hell out of me. And is it just me, or does CEO Eddie Bakhash look like Danny Bonaduce?
But I digress.

Persuasion on the Search Results Page

First published January 3, 2008 in Mediapost’s Search Insider

Chris Copeland took out 2007 with one last jab at the whole “agencies getting it” thing. Much as I’m tempted to ring in the New Year by continuing to flog this particular horse, I’m going to bow to my more rational side. As Chris and Mike Margolin both rightly pointed out in their responses to my columns, we all have vested interests and biases that will inevitably cause us to see things from our own perspectives. Frankly, the perspective I’m most interested at this point in this debate is the client’s, as this will ultimately be a question the marketplace decides. So, for now, I’ll leave it there.

But Chris did take exception to one particular point that I did want to spill a little more virtual ink over; the idea of whether persuasion happens in search. Probably the cause for the confusion was my original choice of words. Rather than saying we don’t persuade people “in search” I should have said “on the search page.” Let me explain further with a quick reference to the dictionary, in this case, http://www.m-w.com/dictionary/persuadeMerriam-Webster:

Persuade: to move by argument, entreaty, or expostulation to a belief, position, or course of action.

In the definition of persuade, the idea is to move someone from their current belief, position or course of action to a new one. The search results page is not the place to do this. And the reasons why are important to understand for the search marketer.

For quick reference, here’s Chris’s counterargument: Persuasion is at the heart of everything that we do in search — from where we place an ad on a page (Hotchkiss’ golden triangle study) to how we message. The experience we drive to every step of the process is about understanding behavior and how to better optimize for the purpose of connecting consumer intent with advertiser content.
I don’t disagree with Chris in the importance of search in the decision-making process, but I do want to clarify where persuasion happens. What we’re doing on the search results page is not persuading. We’re confirming. We’re validating. In some cases, we’re introducing. But we’re not persuading.

As Chris mentioned, at Enquiro we’ve spent a lot of time mapping out what search interactions look like. And they’re quick. Very quick. About 10 seconds, looking at 4 to 5 results. That’s 2 seconds per listing. In that time, all searchers can do is scan the title and pick up a few words. From that, they make a decision to click or not to click. They’re not reading an argument, entreaty or expostulation. They’re not waiting to be persuaded. They’re making a split-second decision based on the stuff that’s already knocking around in their cortex.

Part of the problem is that we all want to think we’re rational decision-making creatures. When asked in a market research survey, we usually indicate that we think before we click (or buy). This leads to the false assumption that we can be persuaded on the search page, because our rational minds (the part that can be persuaded) are engaged. But it’s just not true. It’s similar to people looking at a shelf of options in the grocery store. In a study (Gerald Zaltman, How Customers Think, p. 124) shoppers exiting a supermarket were asked if they looked at competing brands and compared prices before making their decision. Most said yes. But observation proved differently. They spent only 5 seconds at the category location and 90% only handled their chosen product. This is very similar to responses and actual behavior we’ve seen on search pages.

Now, if someone is in satisficing mode (looking for candidates for a consideration set for further research) you can certainly introduce alternatives for consideration. But the persuasion will happen well downstream from the search results page, not on it.

Am I splitting semantic hairs here? Probably. But if we’re going to get better at search marketing, we have to be obsessed with understanding search behavior and intent. Chris and I are in agreement on that. And that demands a certain precision with the language we use. I was at fault with my original statement, but similarly, I think it’s important to clear up where we can and can’t persuade prospects.

Of course, you may disagree and if so, go ahead, persuade me I’m wrong. I’ll give you 2 seconds and 6 or 7 words. Go!

Satisficing, Bounded Rationality and Search

150px-HerbertSimonHerbert Simon came up with some pretty interesting concepts, among them satisficing, bounded rationality and chunking.

Before Simon, we commonly believed that humans came to optimal decisions in a rational manner, based on the information provided. We took all the data that was accessible, weighed pros and cons and used our cortexes to come to the best possible outcome.

Simon, in effect, said that this placed to high a load on us cognitively. In many cases, there was simply too much information available, so we had to make choices based more on heuristics, cutting the available information down to a more manageable level. He called this “satisficing”, a blend of satisfy and suffice. And Simon started saying this a half century ago. Imagine how this translates to the present time.

We have never had more information available. At the click of a mouse, we can access huge amounts of information. There’s simply no way we can process it all and come to rational decisions. And this brings us to another concept, that of bounded rationality. We’re more rational about some decisions than others. It depends on a number of factors, including risk, emotional enjoyment and brand self identification. Think of it as a chart with three axes. One axis is risk. We put more rational thought into decisions that expose us to greater risk. In consumer decisions, risk usually equates with cost, but in B to B decisions, it could also include professional reputation (related to but not always directly tied to cost). We’re going to put a lot more thought into the purchase of a car or house than that of a candy bar. Another axis is emotional enjoyment. This is a risk/reward mechanism to most decisions, and if the reward is one that is particularly appealing to us, we tend to be swayed more by emotion than rational decision. If we’re planning a holiday, we may make some irrational decisions (or at least, they might appear that way to an outsider) based on a sense of rewarding ourselves. We’ll treat ourselves to a few nights in a 5 star resort, when the 3 star resort would offer greater overall value. The final factor, and one that is usually buried somewhere in our subconscious, is how we use brands or products to define who we are. Now, no one usually admits to being defined by a brand, but we all are, to some extent. This touches on the cult-like devotees that some brands develop. Harley Davidson, Rolex, BMW, Apple and Nike all come to mind. Is a Rolex a rational choice? No. But a Rolex defines, to some extent, the person wearing it. It says something about the person.

Bounded rationality says that there are boundaries to the amount of rational thought that we can and we want to put into decisions. The amount we decide is sufficient depends on the three facts discussed.

Now, the use of Search tends to plot somewhere along this 3 dimensional chart. If risk is high and brand identification is low (buying software for the company), there is a high likelihood that search will be used extensively. If risk is low and brand identification is high (i.e. buying a soft drink or a beer) there is almost no likelihood that search will be used. In this case, the two factors usually work inversely to each other. Emotional enjoyment isn’t as directly tied to search activity. We will do as much (or as little) searching for a purchase that will give us great enjoyment as for those that won’t.

It’s interesting to watch how these factors impact search intent and behavior. Satisficing leads to a classic sort of search behavior, what I call I category search, where we use fairly generic, non branded queries that broadly define the category we’re looking at. Let me give you an example. Tomorrow my wife and I are headed to Europe for a week. We’re going to spend a few days in Portugal, then fly up to London for SMX (where I’ll be talking more about these ideas in some of my sessions). We’re flying into Lisbon, then renting a car and driving down to the Algarve region. I have GPS navigation software for my PDA, but only for North America. I wanted to get European software, but because of the limited use of it, I didn’t want to spend too much. The developer of my North American software didn’t make a EU version, so I turned to search to find a suitable candidate. Here there was no brand identification, some degree of risk (if it didn’t work in Europe, I’d be lost, literally) and no emotional enjoyment factor. My first search was what I call a “landmark” search. I wanted to find some sites to plot the landscape. Sites that listed and compared my alternatives would be ideal matches to my intent.

I searched for “pocket pc gps software”, knowing that “gps software” would be too broad. I soon found the sites were pretty much all about North American versions. Few of them offered or reviewed European versions. I spent several minutes on the TomTom site trying to order a European version from Canada but to no avail. Apparently TomTom doesn’t believe people in North America would ever choose to drive in Europe.

In classic “satisficing” behavior, I wanted to cut my research workload by setting some basic eligibility criteria: it had to work on a Pocket PC, it had to be reasonably priced (under $100 preferably) and it had to offer coverage for all of Europe (we’re going back to France and Italy next year and I’d like to use it then as well). My next search was for “pocket pc gps software europe”. This gave me what I needed to begin to create my satisficed list. Ideally, we want 3 or 4 alternatives to compare. I did find the TomTom choice, but I was already frustrated with this, and the price was over my threshold. Destinator also offered an alternative that seemed to be a little better match. It matched all the criteria, appeared to have some decent reviews and was available on eBay for about $75, including shipping. Sold! Was it the optimal choice? Maybe not. If I had spent hours more doing research, I could have probably found a better package or a better value. But it was good enough.

Chunking has to do with cognitive channel capacity, and the amount of information we can store in our heads, accessible for use. Again, we tend to maximize the available slots by creating chunks of information, grouping similar types of information together.

When you look at Simon’s work, even though the majority of it far preceded search engines, it sheds a lot of light on how we use search in a number of cases. If you want to tap into user intent, I would recommend finding out more about bounded rationality and satisficing. Chunking is probably worth a look as well.

Search and the Digital CPG Shelf

First published October 25, 2007 in Mediapost’s Search Insider

Last April, James Lamberti from comScore, Randy Peterson from Procter and Gamble and I (representing SEMPO) grabbed a relatively quiet corner at the New York Hilton to talk about a potential research project. Here was our wish list:

–    A study that tied together online activity to offline purchase behavior
–    A study that identified the impact of search in a category not typically one that would be identified with search marketing
–    A study that would attempt to quantify the leveraged impact of search with brand advocates

Search and CPG: Are You Kidding?

As you can see, these were pretty lofty targets to shoot for. Choosing the product category was done at that table. What is the last category you would think of as generating significant search activity? Consumer packaged goods. After all, aren’t these either replenishment purchases, where we keep buying the same brand over and over, or a non-considered purchase, where we’re not really concerned with doing much research? Why would we need to turn to a search engine to figure out which toothpaste to buy, or which would be the right chips for Sunday’s ball game? We reasoned that CPG had the “Sinatra” Factor going for it: If search can make it here, it can make it anywhere.

To be honest, we really didn’t know what to expect, but comScore, together with a lot of help from Yahoo and Procter and Gamble, managed to come up with a workable study design. SEMPO jumped on board as a co-sponsor and we put the study out in the field. This week, with numbers crunched and charts drawn, the results were released in a study labeled The Digital Shelf. After several months of holding our collective breaths, we were about to see if people had already locked CPG brands into their brains, eliminating the need to search for product information.

Apparently not.

People went online for CPG information — in fact, to a significantly higher degree than even our most optimistic predictions.  Over a 3-month period, comScore recorded over 150 million visits to CPG websites in four categories: Food Products, Personal Care Products, Baby Products and Household Products. Those are numbers no marketer should ignore. But even more significantly, search drove significant portions of that traffic, from 23% of all visits in Household Products to 60% in Baby Products.

It’s not just automotive or travel that drive search traffic. We search for recipes, how to get the stains out of carpets, the most eco-friendly disposable diaper and yes, even the nutritional information for potato chips. We search, a lot!

And our searching sets us apart as a consumer segment. Searchers tend to be more interested in product information, comparing against competitors and what they need to make a purchase decision. Non-searchers are more interested in special offers and coupons.

Searchers spend more, about 20% more  — in all the categories in the study. In fact, in the Baby Care Category alone, people searching for information and eventually purchasing could result in almost $12 billion in sales.

Search = Opportunity

But perhaps the most compelling finding was this: People search because they’re comparing alternatives. This means they’re not locked into a brand. They could very well be your competitor’s customer right now. Non-searchers are more likely to go directly to a site because they do have a brand preference. They’re just looking for a bargain on that brand. The study found that 36% of searchers had recently switched their brand, compared to 29% of non-searchers. And, interestingly, searchers are less motivated by price. Only 27% of searchers switched because of price, compared to 38% of non-searchers.

So, the study delivered on our original wish list, and then some. It showed that search is a significant influencing factor in the most unlikely product category of all, the stuff on your pantry shelf or under the sink in your bathroom. In fact, I have yet to see a study done on any product category where search didn’t blow the doors off the competition in its effectiveness in connecting with customers. So perhaps the biggest question left unanswered by the study is this: Why are all those branding dollars still going everywhere but search?

Are Our Brains being Rewired?

I have to start out by thanking Nico Brooks and Jess Gao. Without intending to, they both provided me more than enough fodder for a rather lengthy column in Seach Engine Land on Friday.

Nico is the Chief Search Strategist at Atlas. Jess is our intern at Enquiro, who’s currently working towards her doctorate, specializing in cognitive psychology. Through different paths, they both gave me some major brain melting ideas to chew over. I’m still digesting, but you can catch the thought process in action on my column.

But consider this. What if our brains are being rewired by the internet? Some of our behaviors are innate. They’re our OEM operating software, put there by the manufacturer. Flight or fight. The need to procreate. The appreciation of beauty. This stuff is hardwired.

But some of our behaviors are learned. We’ve developed them as we go. The things sit in our temporary memory caches, and we can adjust them if they’re no longer working. The thing that started all this was how we learn to navigate a physical environment. First we look for landmarks, then we memorize routes, then we put the two together to create a cognitive map. Nico’s suspicion (and Nico, I hope I’m capturing the essence of the idea accurately) is that our need to identify landmarks and even our ability to memorize routes is probably innate. It’s just how we are programmed to get around. But cognitive mapping, at least in the essentially rectangular grid pattern that is common in the Cartesian coordinate model, is a learned behavior. Rectangles have no place in the n dimensional space of online, so as we spend more time navigating online, will we change our mapping process?

Then, with Jess, we had a great chat about how we perceive things, especially ads. There’s a great introduction to selective perception that I would urge you to check out. In recent studies we’ve done at Enquiro, one of the interesting findings has been that the more intrusive the ad, the less it seems to work. It registers high in the first stage of perception, stimulation, and manages to succeed in the second, registration, but fails in the last two stages, organization and interpretation.

Other conversations I had this week, that didn’t make it into either of the columns. On Thursday I was in New York for Google’s B to B Summit and had a chance to chat with Mark Martel, who supports the B to B Tech Sales Vertical at Google. Mark has a healthy intellectual curiosity and I always enjoy chatting with him. We discussed schemas and how important they are in the process of perception. Then, on Friday, I was in Toronto chatting with the Yahoo Canada gang, including Maor Daniels and Adina Zointz (what a great name, literally covering everything from A to Z!) and we talked about how quickly we’re learning to judge the authenticity of content online. It’s as if our bullshit filters are more finely tuned than ever.

I’m definitely on a riff here, but there’s a lot of threads coming together. Even in someone of my ever upwards creeping years (I’m 46) I suspect my synapses are under construction. Old routes are being torn out and new ones are being built. And with my daughters, many of the paths are being built differently right from the start. The routes that were so important to me in grade school, times tables, rote memorization, etc, are becoming overgrown with weeds through lack of use. But new routes I never even thought of, like how to do homework, carry on an online chat and watch the TV with one eye, are being upgraded into major turnpikes. Multitasking is a major operational imperative now, and selective perception is kicking into overdrive.

Anyway, to further dive into some of the things on my mind, here’s some of the columns where I’m beginning to open up some of these ideas to the fresh, online air:

Infomediating a Broken Marketplace – a look at Hagel and Singers Infomediary model from their book Net Worth. Is Google aiming to be the ultimate match maker in the marketplace?

4000 Ads a Day, and Counting – Part One of the Infomediary Doubleheader, looking at the disconnect between customers who just want the facts, and advertisers that just want to control our buying habits

Some Big Ideas for a Friday – Some musings about how we perceive advertising, based on recent studies we conducted, and how we might be remapping the perception process

How We Navigate Our Online Landscape – The original exploration of landmark, route and survey knowledge and how it may map (or not) to how we navigate our online space

And please, do me a favor. This is all stuff I want to explore further in the book. If you think I’m full of bullshit, call me on it. Share your thoughts. Post a comment. Start a dialogue. I know it’s a pain in the ass posting comments on blogs because of spam, but PLEEASSSE take a few moments to do so. Or drop me an email.

On Your Search Menu Tonight

First published October 4, 2007 in Mediapost’s Search Insider

This week Yahoo unveiled a new feature. It doesn’t really change the search game that much in terms of competitive functionality. If anything, it’s another case of Yahoo catching up with the competition. But it may have dramatic implications from a user’s point of view. To illustrate that point further I’d like to share a couple of stories with you.

The feature is called Search Assist. You type your query in, and Yahoo provides a list under the query box with a number of possible ways you could complete the query. This follows in the footsteps of Google’s search suggestions in its toolbar. Currently, Google doesn’t offer this functionality within the standard Google query box, at least in North America. Ask also offers this feature.

Because Yahoo is late to the game, the company had the opportunity to up the functionality a little bit. For example, the suggestions that come from Yahoo can include the word you’re typing anywhere in the suggested query phrase. Google uses straight stemming, so the word you’re typing is always at the beginning of the suggested phrases. Yahoo also seems to be pulling from a larger inventory of suggested phrases. The few test queries I did brought back substantially more suggestions than did Google.

It’s not so much the functionality of this feature that intrigues me; it’s how it could affect the way we search. I personally have found that I come to rely on this feature in the Google toolbar more and more. Rather than structuring a complete query in my mind, I type the first few letters of the root word in and see what Google offers me. It leads me to select query phrases that I probably never would have thought of myself.

Some time ago I wrote that contrary to popular belief, we’ve actually become quite adept at paring our queries down to the essential words. It’s not that we don’t know how to launch an advanced query; it’s that most times, we don’t need to. This becomes even truer with search suggestions. All we have to do is think of one word, and the search engine will serve us a menu of potential queries. It reduces the effort required from the searcher, but let me tell you a story about how this might impact a company’s reputation online.

I Wouldn’t Recommend That Choice

Some time ago I got a voicemail from an equity firm. The woman who left a message was brash, a little abrasive and left a rather cryptic message, insisting that I had to phone her right back. Now, since I’m in the search game, getting calls from venture capitalists and investment bankers is nothing really new. But I’d never quite heard this tone from one of these prospecting calls before. So, I did as I usually do in these cases and decided to do a little more research on the search engines to determine whether I was actually going to return this call or not. I did my quick 30-second reputation check.

Normally, I would just type in the name of the firm and see what came up in the top 10 results. Usually, if there’s strong negative content out there, it’s worth paying attention to and it tends to collect enough search equity to break the top 10. This time, I didn’t even have to get as far as the results page. The minute I started typing the company name into my Google toolbar, the suggestions Google was providing me told the entire story: “company” scam, “company” fraud and “company” lawsuits. Of the top eight suggestions, over half of them were negative in nature. Not great odds for success. Needless to say, I never returned the call.

If these search suggestions are going to significantly alter our search patterns, we should be aware of what’s coming up in those suggestions for our branded terms. Type your company name into Yahoo or Google’s toolbar and see what variations are being served to you. Some of them may not be that appetizing.

Would You Prefer Szechuan?

My belief is that users are increasingly going to use this to structure their queries. It moves search one step closer to be coming a true discovery engine. One of the overwhelming characteristics of search user behavior is that we’re basically lazy. We want to expand a minimal amount of effort but in return, we expect a significant degree of relevance. Search suggestions allow us to enter a minimum of keystrokes and the search engine obliges us with a full menu of options.

This brings me to my other story. Earlier this year we did some eye-tracking research on how Chinese citizens interact with the search engines Baidu and Google China. After we released the preliminary results of the study, I had a chance to talk to a Google engineer who worked on the search engine. In China, Google does provide real-time search suggestions right from the query box. The company found that it’s significantly more work to type a query in Mandarin than it is in most Western languages. Using a keyboard for input in China is, at best, a compromise. So Google found that because of the amount of work required to enter a query, the average query length was quite short in China, giving a substantially reduced degree of relevancy. In fact, many Chinese users would type in the bare minimum required and then would scroll to the bottom of the page, where Google showed other suggested queries. Then, the user would just click on one of these links. Hardly the efficient searching behavior Google was shooting for. After introducing real-time search suggestions for the query box, Google found the average length of query increased dramatically and supposedly, so did the level of user satisfaction.

Search query suggestions are just one additional way we’ll see our search behavior change significantly over the next year or two. Little changes, like a list of suggested queries or the inclusion of more types of content in our results pages, will have some profound effects. And when search is the ubiquitous online activity it is, it doesn’t take a very big rock to create some significant and far-reaching ripples.

In Search of B2B Landmarks

First published September 27, 2007 in Mediapost’s Search Insider

This week (actually, right about the time you’ll be reading this column) I’ll be talking to the American Business Media Publishers Summit in Chicago about online opportunities, from a user’s perspective. As I was getting ready for the address, I realized there’s a substantial piece of the B to B market that’s missing online. I call it a market enabler.

Looking for Landmarks

Think of our typical progression when we begin researching something online. If it’s new territory, the first thing we need to do is to find a landmark to navigate from. From that landmark we tend to navigate out from it. This is true both in the online and real world. Think of Google as everybody’s favorite landmark. It’s the starting point of nearly all our online navigation, because we know we can always get back to it if we’re lost. In fact, it becomes the vehicle of our online navigation in almost all cases. The only time we deviate from it is if we have enough familiarity with a certain section of the online landscape that we can find other online landmarks without it. For example, if I’m planning a trip somewhere, I usually don’t start at Google. I either start at one of the travel tools I have bookmarked (Farecompare.com, Kayak, Sidestep) or at my favorite travel community, Tripadvisor.com. I’ve been down this path before, so I’ve memorized other familiar landmarks. Otherwise, I always start at Google.

But there are some things we look for in our landmarks. We want them to be recognizable. We want them to be authoritative. We want them to be comprehensive. And usually, we want them to be relatively agnostic. We don’t want to be pushed in any particular direction. We want to choose our own paths. We want a neutral marketplace that allows us to compile our own consideration set, not have it built for us.

Making Life Easier

It also helps if our landmarks incorporate some strong navigational and comparison functionality. One of the best things about the travel sites and tools I’ve mentioned is their sophisticated search and filtering capabilities. They beat Google at this particular game. They’re a more useful landmark to navigate from within. And increasingly, they’re incorporating authentic community dialogue and reviews with the search functionality. I can search, sort and qualify, all in one place. They make the difficult job of planning a trip easier. They’re market enablers, because they allow us to compare alternatives more effectively. If we look at the two best examples of market enablers, eBay and Amazon, they share all of the above characteristics.

So, let’s return to the B to B marketplace. In our B to B survey, we found that almost everyone starts with Google, because most of the time when we research B to B purchases, we’re starting in unfamiliar territory. We have no landmarks. And while we usually end up going fairly quickly to vendor sites, the survey found a strong desire to find an unbiased landmark as the market’s middle ground. Yet, no enablers have strongly established themselves in this position. There is no eBay or Amazon, or even a TripAdvisor, of B to B. There are vertical engines, including Business.com, Knowledgestorm, KellySearch, ThomasNet and others, but none have dominated the landscape to this point.

Sorting through the Haystack

In a recent B to B panel I moderated, consultant Karen Breen Vogel mentioned that these vertical properties do restrict the scope of the search, so rather than looking for a needle in a haystack, you’re looking for a needle in a needlestack. While this is true, it can still be a pretty painful process if you’re looking for the right needle. The problem is that the B 2 B marketplace is vast and fragmented. Also, there are no obvious affiliation or revenue opportunities, as there are in the travel business. There isn’t an obvious money trail to follow in the B to B world to make enabling the marketplace a potentially lucrative proposition. Most of the players have morphed over from being directory publishers in the offline world, and are still following the paid listing model. Unfortunately, this doesn’t lend itself to the neutral marketplace favored by researching buyers.

There are few purchase processes that are more difficult or taxing than a complicated B to B one. Sorting out potential vendors can be a long, tedious and frustrating process. First of all, there’s no emotional investment. This isn’t planning a vacation. This is your job. Secondly, the risk level is extremely high. Screw up, and your job may evaporate. While the potential to make money may be obscured by the challenges, the buyer’s need is painfully obvious. And I can’t help thinking, if eBay could do it, given the immense diversity of its marketplace, there must be a way.