The Coming Storm: Search and Consumer Privacy

First published November 9, 2006 in Mediapost’s Search Insider

Earlier this week, in OnlineSpin, Seana Mulcahy wrote about two new complaints filed by consumer groups with the Federal Trade Commission. The shadowy subjects of tracking online behavior, analytics and targeting are outlined in the complaints.

Earlier this year, in an interview, I predicted a showdown between search engines and consumers around privacy issues. I suspect these two complaints could be the harbinger of the coming storm.

The Natural Convergence of Search and Behavioral Targeting

It makes all kinds of sense for the worlds of search and behavioral targeting to overlap, and the conjunction of those two worlds is a very powerful place indeed for the marketer. Behavioral targeting allows you to track and target potential customers based on their click stream. You can identify promising click streams based on sites visited and behavior on those sites. The odds of picking the right person at the right time to receive your message go up substantially.

Now let’s look at search. At some point in the buying cycle, which is mirrored by the click stream, almost all consumers will turn to a search engine to look for more information. This is a rather momentous point. At the earliest occurrence, it often indicates when the consumer switches from awareness to consideration. It’s when they become actively engaged in the act of purchasing, which puts them in a whole new mindset. From that point forward, they could turn back to the search engine at different times to assist them in the purchase. The key is that consumers who are using a search engine are very receptive to information about the product or service, because they’ve requested that information. Push turns to pull.

 

The Challenge with Search

The problem with search right now is knowing where the consumer is–at which touch pointIs it early in the cycle, near the beginning of the consideration phase, when consumers are compiling candidates for their consideration set? Is it somewhere in the middle, when they’ve assembled their set and are comparing features or looking for reviews? Is it when they’re ready to purchase? It’s almost impossible to tell from the query, because as past comScore studies have shown, there is often not a search funnel. The same query could be used at each point in the cycle.

Given this inability to disambiguate intent from the query, most marketers aim for the sure bet. They go for the purchase, because it’s much easier to track conversions and ROI. Do a search right now on any engine for “digital cameras” and look at the sponsored ads that appear. I guarantee they’ll be aimed at someone ready to purchase. Is this the query you would use if you had done your research and were ready to purchase one specific model? Would you even buy online? Probably not. But it is the query you would use if you were starting to consider your options.

You’re not alone. The marketers on the results page are missing over 80% of potential buyers by focusing on the less than 5% who are ready to buy now. It’s just not a good match-up for the advertiser or the consumer.

Enter BT

Now, if you were able to combine behavioral targeting with that all- important search touch point, you could serve a research-based ad if you knew at what stage in the buying cycle the consumer was, based on his online visits. You could take the guesswork of matching the message to the person. And finally, we could start to pull away from the pure direct response tactics that restrict the effectiveness of search. It’s tremendously powerful.

This is not something in the far-distant future. The mechanisms are already in place for search engines to track your online behavior. Tool bars, mini apps, personal search history. All of these can and do track where you’ve been. Everybody is being tracked to some degree.

But as Seana pointed out in her column, most of us are blissfully unaware of it. That’s because it’s been relatively benign to this point. In return for a handy tool bar that offers increased convenience, the ability to index your desktop and other added functionality, we just click the accept button without really reading what we’re accepting. Up to now, there hasn’t seemed to be any consequences. But in the background, the engines are quietly collecting terabytes of click-stream data. And the time is coming when that data will be put to use.

Privacy Storm Front

At first, it will be subtle and a little unsettling. The search ads we’ll be seeing will be targeted much more precisely. They will seem to speak just to us. It will be like the advertiser is reading our mind. We’ll be thrilled at first, but eventually, we’ll read an article somewhere that will explain the uncanny ability of the advertiser to give us just the right message. It’s because they’ve been watching us, tracking what we do online. And it won’t just be on search, it will be throughout the search engine’s advertising networks.

“Hmmm” you’ll say to yourself, “I’m not sure I’m okay with that.”

More and more consumer groups will launch protests. Politicians will sense opportunity and jump on their soapboxes. There will be a very vocal minority that will rail against this “Big Brotherism.” There will also be a group of advertisers that will continue to step way beyond the acceptable, using targeting to subvert the user experience, rather than enhance it, hijacking the user and taking them to places they never intended. This will add fuel to the fire. And because they’re the most visible target, the search engines will bear the brunt of the attack.

In the end, we’ll realize there’s much more pro than con here. Effective targeting will generally add to our experience, not take away from it. We’ll toy with trying to use a third-party privacy filter, but in the end, most of us won’t be willing to give up the additional functionality in return for maintaining an illusion of anonymity online. Much of the usefulness of Web 2.0 (I know, I hate the term too, but at least it’s commonly understood) will be dependent on capturing personal and click-stream data. We’ll give in, and the storm will gradually fade away on the horizon.

At least, that’s my prediction.

Thou Shalt Not Google (unless it’s on Google)

First published November 2, 2006 in Mediapost’s Search Insider

goo-gle: Function: transitive verb: to use the Google search engine to obtain information about (as a person) on the World Wide Web
Merriam-Webster Online Dictionary.
Of all the things that Google’s lawyers have in their basket, apparently stamping out inappropriate use of “Google” as a verb is right on top of the stack. It apparently irks them no end.Now, I can really sympathize here. It’s a little known fact that my last name has actually suffered the same fate as Google. In Japan, of all places, Hotchkiss has become the generic name for the office stapler. Each time a worker lost in the maze of cubicles at Mitsui and Co. says, “Pass me the Hotchkiss” I die a little inside. I kid you not! Check out Wikipedia.Mind your Ps and GooglesNow, according to a post on Google’s official blog, it’s not the fact that we Google on Google that causes the Google legal department to have hissy fits. It’s if we try Googling on Yahoo and MSN. It can’t be done. Not all tissue papers are Kleenex, not all copy machines are Xeroxes. To quote the post:

You can only “Google” on the Google search engine. If you absolutely must use one of our competitors, please feel free to “search” on Yahoo or any other search engine.

Hmmm..people are using the word “Google” to refer to Google’s competitors, and it’s Google that’s upset? Unless I’m missing something here, shouldn’t it be Yahoo and MSN that should be miffed?

I Google, therefore I am…

The inclusion of Google in the English lexicon is “faintly unsettling,” according to the folks at Google. They fear that Google will lose its identity as a trademark once it slips into common usage. They explain:

A trademark is a word, name, symbol or device that identifies a particular company’s products or services. Google is a trademark identifying Google Inc. and our search technology and services. While we’re pleased that so many people think of us when they think of searching the web, let’s face it, we do have a brand to protect, so we’d like to make clear that you should please only use “Google” when you’re actually referring to Google Inc. and our services.

Now, I know that Google has way too much money, and they have a team of very bright 12-year-old lawyers (or at least, they look 12) trying to reinvent the law. But in this case, I would suggest slipping down to the Google cafeteria for a double decaf low fat cappuccino and relaxing. There are better windmills to tilt at than this one.

Once again, who’s in control?

The irony here is that the very entity that has probably done more than any other to put control in the hands of the consumer is now fretting because consumers are exercising that control. We associate search with Google. We endorse the brand by using it as a verb. It’s just this critical mass that makes Google such a formidable competitor in the highly promising search market. Frankly, it’s not the fact that their brands became generic terms that hurt many of the companies that Google uses as examples. It’s because the companies became complacent and let the competition catch up, losing the distinction that their brand once afforded them. The consumers didn’t take the brand away from the company, the company surrendered the brand to the competition.

In the corporate culture that says “don’t be evil,” apparently improper use of “Googling” is now defined as evil. Just to make it clear, Merriam-Webster defines evil as “morally reprehensible.”.  Perhaps someday “google” will also mean “to spend one’s time unproductively fighting frivolous legal battles.” At this point, it’s a toss-up with “disney.”

A final word to Google’s legal team: As you’re putting together those multi-page lawsuits, go ahead and feel free to use the Hotchkiss. I don’t mind.

What Happens when the Whole World Becomes Searchable?

First published September 21, 2006 in Mediapost’s Search Insider

There are a few items that crossed the threshold of my inbox recently that led me to speculate about search in the grand scheme of things.

First of all, fellow Search Insider David Berkowitz talked about online data storage, and how it could introduce reams of new content into online depositories, there to be connected to by consumers through search.

Secondly, Apple and Google are in talks about iTV, Apple’s new set-top box that allows you to view downloaded video on your TV, at the same time making it searchable.

Welcome to e-World

The fact is, the whole world is becoming digitized and indexable. It’s not a new trend, it’s been making inroads for the last two and a half decades, but there seems to be a tipping point of convergence that’s rapidly approaching. National and international news is almost fully digitized, and local news is following in the same footsteps. There are now digital editions of most periodicals. And Google is doing its level best to digitize every book ever written. So the print world is well on the way.

The Genetics of Music

For electronic media, music is largely in the digital domain, and the searchability of it is rapidly improving. The biggest bottleneck is in trying to categorize and rationalize what is largely a subjective experience. I either like music or I don’t. How do you make that searchable? Well, interestingly, Pandora’s Music Genome Project is trying to do just that. Since 2000, it has analyzed hundreds of thousands of songs based on over 400 attributes or “genes” (hence the Genome moniker) which include melody, harmony, rhythm, instrumentation, singing styles, lyrics and arrangements, to name just a few. It’s a large-scale attempt to make music searchable by something other than genre, artist or title, which is far too limiting for most of us. The Pandora interface, in its attempt to be intuitive, doesn’t allow for power searching, but it’s still a quantum leap forward in allowing us to help define our likes and dislikes in the musical universe.

What You See is What You Search

If you take this same approach to video entertainment, there is a much more complex, and therefore richer, content depository to mine. Think of the universe of movies, TV shows and documentaries that exists, each loaded with dialogue, topicality, visuals and styles. As complex as music can be, video explodes the content to be categorized and analyzed in a dozen different directions. It provides a huge indexing challenge, but therein lies the promise and profitability. And it appears to be a challenge that Google is ready to take on. Of course, we haven’t even touched on aspects like consumer-generated video content (the YouTubes of the world, which seems to be the latest overladen bandwagon) and social tagging.

We’ve Only Just Begun…

But that’s the globally visible world, the tip of an immensely large iceberg. There is very little in our physical world now that isn’t digitized somewhere. There is a virtual mirror for almost every physical presence. Store inventories exist in the digital domain, and have for some time. Aggregating those inventories and making them searchable turns the entire world into your personal shopping mall. We leave GPS trails as we move from point A to B. Our vehicles churn out detailed performance summaries via the onboard computer as we do so. Mobile computing makes the very stuff of our personal lives; our thoughts, our activities, our appointments, our contacts, all digital and indexable. At work and at school, we all produce content on a daily basis. My daughters are content producers each time they do homework, and increasingly, that work is in bits and bytes.

As the barriers disappear between our hard drive and the Net (the subject of David’s column) all this content theoretically can enter the public domain and be searchable. Increasingly, the question we ask ourselves is “where do I draw the line between my private and my online world?” File sharing becomes a substantially bigger deal.

Brain Melting Questions

Fellow blogger Mitch Joel calls these kind of questions “brain melters.” I like that. It captures the mind-numbing aspects of this stuff. Our electronic footprint is now bigger, and in some ways more real, than our physical one. There is this vast binary universe out there, terabyte after terabyte of data that grows each and every second, capturing the essence of who we are and what we do. And the sole door to that world, the channel we all must pass through to gain entry, is search. In the act of searching, we connect to that universe.

Cast the search question in that light. Realize that we have yet to scratch the vast potential of this fundamental glue that holds the Internet together and bonds us to it. Imagine owning the solitary access point to everything!

Google, Yahoo and Microsoft are jockeying for position to do just that. It should excite the hell out of their respective shareholders, but it should scare the hell out of us. Do we really want this much power in the hands of so few?

These are big questions, and I’d love to get your viewpoint. Leave your thoughts on the Search Insider blog, or drop me an email at gord@enquiro.com.

What Happens When the Whole World becomes Searchable?

My Search Insider column today was big picture stuff, looking at how search can connect us to a digitized world.

Here’s an excerpt:

There is this vast binary universe out there, terabyte after terabyte of data that grows each and every second, capturing the essence of who we are and what we do. And the sole door to that world, the channel we all must pass through to gain entry, is search. In the act of searching, we connect to that universe.

Catch the rest of the column at MediaPost.

The column drew some interesting responses, both on the Search Insider blog and emailed to me.

Martin Edic truly thought globally

In the spirit of creating a ‘brain melter’, imagine the extension of search created by GPS and satellite imaging. Suppose I want to create a search engine devoted to global climate change. If I can access these sources I could literally do a planetary search that included both digital data a geographoc, geological, weather and other environmental data all viewable as imagery, maps, text, etc.

David Gust took exception to my plaudits for Pandora: I initially thought Pandora was great, but eventually it became monotonous. A descriptor genome for the music is great, but it doesn’t decipher the music consumption genome in me.

My point is that indexing means little without context. Context is about behavior and that is where the true focus must be placed to truly unlock value of “Indexing the World”

Derick Harris,w ho obviously has a lot of time on his hands, took me to task for my “pointless” vision of an Orwellian future

I do wish that these marketing rhetoricians of search, such as Mr. Hotchkiss, would “think first” about what they are asking, in terms of “big questions” — instead of wasting our time with patently pointless essays that amount to self-serving indulgences posing as questions that really amount to a whole world Googleized into an information hell.

…Ouch! Sorry Derick, I obviously hit a sore spot.

And in the spirit of wired “Big Brother”, Warren Peace (come on..that can’t be your real name. But if it is, kudos to your parents!) shared his vision of a database schema for a “global object database” or GOD for short…

whereby every kind of digital data could be stored, indexed and cross-referenced, and rated for accuracy (couldn’t find funding for it, though). One issue is that many things are analog, not digital, and digitizing them means losing important information. An image of a person and a list of their interests is NOT the person, just an avatar. Do we really need an avatar of every living thing?

Perhaps that’s what the real “God” is – an analog, searchable object database that details absolute accuracy.

Talk about your brain melters!

Google and the Future of Video

The talks that Google and Apple are currently in about video will likely start defining the future of video entertainment as we know it. And it’s just one more example of “push” going to “pull”.

The news story is about iTV, the new device that bridges the gap between the TV and the PC, letting you viewed video from your hard drive on your TV. It’s the continuation of convergence that I’ve been talking about for some time now.

But what is interesting about this to me is not so much the hardware as the extension of searchability to online entertainment. It’s just a matter of time before the walls come down between something like YouTube and the world of broadcast TV. They’re already crumbling rapidly. And setting your viewing preferences based on searchability opens up a whole new world. I’ve had just a taste of it through Microsoft’s Media Center and I like it. You can search up to two weeks of programming by keyword, looking for a particular topic, director or actor.

Now, let’s extend this the next logical step. Let’s open up the rapidly exploding world of video. All the movies, all the tv shows, all the documentaries ever made, as well as the crushing wave of consumer generated video content, all as searchable as the web thanks to Google. You in the mood for a show about 9/11 conspiracy theories? A quick search and you’re watching Loose Change. Plus, Google suggests other shows you might be interested on based on your topic. It’s just a matter of time before somebody does for video what Pandora is doing for music, allowing you to explore the world of video entertainment based on similarities to what you already like.

Social tagging opens up more possibilities, allowing you to tap into the most popular choices of the various online communities you belong to. The buzz effect takes over (as we see currently on YouTube) and suddenly watching online video becomes a communal experience.

It’s a revolution in video distribution, and the seeds are being sown currently in the chat that Steve Jobs and Eric Schmidt are likely having as we speak.

Google Dropping Sponsored from the Golden Triangle?

Whoa..this is a bold move!

Just saw a thread on Webmaster World that indicates Google is testing removing top sponsored ads after a number of searches where a user doesn’t click on anything. Tried it myself and sure enough, after 4 or 5 refreshes, top ads were gone.

After refreshing on the same query, the ads disappeared for that query, and any modifications of the query, but still showed for a totally different query. After I went through the same process with the new query, all my top ads disappeared.

If Google sticks with this, it demonstrates a huge dedication to the user experience. Our research has shown how valuable this real estate is from a monetization perspective, but Google’s feeling (and rightly so) is that if you’re skipping past it anyway, the probability of a click on these ads is minimal. Why impair the user experience but taking up prime real estate with something that the user is just filtering out anyway.

I did some more testing with some different patterns to see where the sponsored filter seems to be tripped. If you do a number of different searches without clicking on sponsored listings, it doesn’t seem to kick in. It’s only if you do a lot of return visits to the same set of search results without hitting a sponsored link. But once the ads are gone, they’re gone for every query from then on til you clear your cookies.

Ironically, my only hesitation with this is from the user experience perspective. My feeling is the thresholds might be set too low. Intent plays a huge part in how we interact with search listings, and this can vary greatly from search to search. It’s also very difficult to determine from the nature of the query. So, if I’m in a fact finding mode, even if I’m using what appear to be very commercial terms, and I skip over ads on 4 or 5 subsequent returns to a page, that doesn’t necessarily mean I don’t want ads on any search. One anomalous search could filter out top sponsored results for days, weeks and even months and the user would never know what happened. There is no indication on the page that Google is applying any type of filter. There is no way to turn them back on. For 99.9% of web users, they’d never know what happened.

Now, it’s not all ads, but only the top ones that disappear. But the fact is, the difference between visibility and performance of ads in the two locations is so significant, that moving the top ads over to the side is almost like removing the ads from the page. Almost everyone starts scanning at the top of the page.

Google’s intentions are noble here, but they’re actually removing control from the user. I’m a big champion of organic results, so I can’t believe I’m saying this, but Google might be too hasty in stripping out top sponsored ads. In two different eye tracking tests, we found that it was clicks on these top sponsored links that actually offered the highest success rates for users. I’ll be watching with great interest to see how the test progresses.

Tales of Pogo Sticks, Bouncy SERPs and Sticky Pages

First published September 7, 2006 in Mediapost’s Search Insider

Much of what little strategy exists in search marketing is aimed towards the first click from a results page (also called a SERP). The position, the messaging and the landing page experience all assume that we’ve captured that all-important first click. But what about the subsequent clicks? In the search business, this is called pogo sticking, the bouncing back and forth from the search page, and clicking on a number of sites in sequence in an effort to find what we’re looking for.

Desperately Seeking Pogo Stats

We know pogo sticking exists, but when I tried to quantify how common it was, I quickly ran into a lot of closed doors. I tried all the major engines and was told that they don’t divulge that type of information, even in aggregate form. I also tried the monitoring services (comScore, Nielsen, Hitwise) but again came up empty.

So, failing anything more quantitative, we had to turn to our own limited data set. The stats below come from the combination of eye-tracking sessions, where we’ve been able to look for pogo sticking. I’m not sure how accurate it is, but it’s the best we’ve got, so I present it with a whackload of caveats.

We saw pogo sticking occur in 49 percent of the sessions we looked at. We suspect the occurrence of this type of behavior would be even higher in real-world settings. So at least one out of every two searches results in a return visit to the results page. In our sessions, 21.5 percent of them results in two clicks from the SERP, 10.4 percent in three clicks, 4.9 percent in four clicks, and 5.5 percent in five clicks. The remainder (6.8 percent) clicked six times or more.

Google has the fewest pogo sticking sessions, with only 36.4 percent of them resulting in a round trip to the SERP. MSN had the highest percentage, with 59.4 percent. Even if you question the numbers (and you have every right to do so) I believe it’s a pretty safe bet that pogo sticking is a pretty common occurrence.

The Power of the Pogo

Why is this important? Because a return visit looks significantly different than the first visit. And if it happens at least half the time, it’s a factor we’d do well to consider as we lay down our search strategies.

I strongly recommend that all search strategies take into consideration the mind-set of your target customer, within the context of what else appears on the page. This exercise can help you forecast the receptiveness of your target to your position on the page, the messaging you present, and the landing page experience you provide.

Let’s walk through a typical scenario. Our target customer searches for “hybrid SUV’s.” Because we’ve done our market segmentation homework, we know our target is early in the buying cycle, and is looking for alternatives for fuel-efficient SUVs, building a consideration set.

Eye-tracking studies have shown there’s relatively little variance in the scanning activity with most searchers at the beginning. They tend to start at the top and work their way down, with a strong bias toward the No. 1 organic spot. Therefore, in this scenario, we have to look at how enticing these top listings are. In walking through this on a search engine, GM and Lexus had purchased the top sponsored spots, where the majority of searchers start their scanning. The first organic spot belongs to the site hybridcars.com, a comparison of available hybrid SUVs. Given our target and his intent, it’s very likely that this site will capture the majority of first clicks from the page.

Beyond the First Click

If we’re playing in this real estate, we have to look beyond the first click to what might happen on the second and subsequent clicks. Scan patterns spread around more evenly on the page on return visits, without the very strong upper-left bias that tends to create the so-called “Golden Triangle” (so-called because we called it that). People tend to fixate on where the last listing clicked, and then can head out in multiple directions from there, either continuing down the listings, skipping up to take another look at the top sponsored, or even a quick glance across to the side sponsored ads. Whereever they choose, their interactions will now be colored by what happened in that first click.

Our strategy now has to account for the influence of that likely first click. We have to know how it will alter or reinforce the intent of our user. We also need to know how sticky the landing page behind that first click is. Is it the type of page that will hold him, and possibly send him off in another direction, or is it a quick bounce back to the SERP because it isn’t well aligned to our target’s intent? Does it reinforce our brand, or our competitor’s? What appears above the fold, and what appears below the fold? Again, we know from eye- tracking studies that this is the critical divide of the page in terms of scanning activity.

When one realizes the impact of pogo sticking, it suddenly means that our search strategy doesn’t play out in a vacuum. It’s intimately dependent on what else appears on the results page, and the most likely paths our target will take from that page. It increases the complexity of our strategy exponentially. The only way to successfully navigate it is to have a clear view of the intent of our target. Sure, it makes search marketing more difficult, but it also makes it infinitely more interesting!

Psst – Want a Hot Spot Paisano?

First published August 24, 2006 in Mediapost’s Search Insider

Surgeon General’s Warning: Prolonged exposure to the Internet can lead to physical dependency and addiction. Use of the Internet can increase levels of anxiety and reduce attention spans.Hello, my name is Gord, and I’m addicted to the Internet. I didn’t realize I was addicted until I recently spent three weeks in Europe and had to go through withdrawal. But after hanging around hotel lobbies trying to get a hit from a local hot spot, I’ve had to face up to the fact that I can’t kick the habit. I need my broadband, baby!

Fear and Loathing in l’Italia

I didn’t go totally cold turkey. I had my PDA to keep up on e-mails, but it just didn’t give me the rush I was looking for. Here I was, surrounded by the culmination of centuries of artistic achievement, and all I could think about was where my Google hook-up was coming from.

I speak somewhat facetiously, but there’s a lot of truth here. Here’s an online definition of addiction:

    1. Compulsive physiological and psychological need for a habit-forming substance.
    2. The condition of being habitually or compulsively occupied with or or involved in something.

It seems to me that going online qualifies on both counts. There’s no doubt that being online is habit forming. But it goes further than that. I realized in the last 20-plus days that it’s hard-wired into my physiology. Not having instant access was as foreign as not having my right hand.

I use online a lot, mainly to access and assimilate information. I enhance what I see in the real world by researching it online, letting me place it in context for myself. And for the past three weeks, every sense I have has been bombarded to the point of overload by input. Art, history, locations, music, literature, architecture, it was all right in front of me. Paris, Florence, Rome: cradles of civilization that I was standing in the center of, and it was if I couldn’t fully assimilate them, because I didn’t have access to an essential part of my cerebral hardware: the right brain, left brain and “wired” brain.

What’s it worth to you, amico?

The analogy carries even further. Accessing the Internet while traveling in Europe is rather like hunting for illicit substances, in that it can be difficult to find and notoriously expensive. Five euros (a little over six dollars U.S.) for fifteen minutes, thirteen euros for an hour, thirty euros for a day… I have a price list for hot spots around the continent imprinted in my memory.

I wasn’t the only one that went through withdrawal. My wife and two daughters showed similar symptoms, but for different reasons. For me, it was losing a logical and information-gathering extension of myself. For them, it was losing a communication channel. They have adopted e-mail as a primary way of keeping in touch (and instant messaging, in the case of my oldest daughter), and they felt somewhat cut off. This was somewhat demonstrative of the way men and women tend to use the Internet, something I talked about in a previous column.

This is your brain on high-speed

But addictions aren’t always harmful. One could argue that we’re addicted to oxygen. Breathing is certainly habit-forming. So is there anything wrong with developing a strong dependence on the Internet?

One theory that I have is that our brains tend to gear up a notch when we go online. There is so much we do through computers that we have difficulty  maintaining linear thinking when we’re online. Even if we’re focused on one task, there’s the knowledge that there’s e-mail to check, things to look up, a hundred other things that we could be doing. Being online seems to increase our level of both anxiety and distraction, just because it’s so damn useful in so many different ways. Focus is a tough thing to maintain.

We have seen manifestation of this trend in the way people act when online. It’s nothing short of frenetic, skipping all over the page, multi-tasking, grasping information in a hundred little forays around the screen. It’s a different interaction from much of what we do day to day. Is it harmful? I’m not sure, but it does seem to be making permanent changes in the way we learn and communicate.

Anyway, I’m back in the office tomorrow, and will once again have my cerebral cortex plugged back into the Matrix. I’ll be wired again. I guess that’s a good thing, but I’m sure going to miss the espressos, Chiantis and Calabrese salsiccia.

Oh, well, everything in life is a trade-off.

What’s Up with Verticals?

First published July 27, 2006 in Mediapost’s Search Insider

You probably haven’t given a lot of thought lately to vertical search results, that thin sliver of search real estate that is sandwiched between the top sponsored ads and the top organic ads, and generally shows a few lines of news results, or local, or products. I have. Don’t panic, there’s really no reason why you should have. It’s really just a sad comment on my day-to-day activities. But I’ve noticed some things, and I think it’s incumbent upon me to share them with you. So let’s get vertical for a few moments, shall we?

In a Location Near You

First, this is prime real estate. When vertical results appear on the major engines, they appear smack in the middle of the hottest part of the page. After a number of eye tracking studies, we can say with a degree of certainty that most searchers (upwards of 80 percent) at least look at the top sponsored ads and the top three or so organic ads. That means that vertical, wedged in between, will be at least grazed over by a lot of eyeballs.

But position is not enough. Working the vertical angle is not just about grabbing some prime real estate. Verticals have to offer information scent. The information, links and visual cues they offer have to align with the user’s intent. In one bizarre example we saw during our latest study, somebody searched on Google for “digital cameras.” For some reason, Google saw fit to return news results for digital cameras. Now, just what percentage of the over two million people who searched for “digital cameras” last month (a quick estimate courtesy of Yahoo) do you guess would be looking for the scoop on how Nikon had to recall 710,000 digital camera batteries? Maybe the ex-product manager from Nikon, in between looking for new jobs on Monster, but that’s about it.

Hopelessly Devoted to OneBox?

While we’re on the subject, what’s the deal with Google and verticals anyway? Search pundit Greg Sterling said in a blog post some time ago that Google had an “almost religious devotion to OneBox,” its vertical label of choice. Could be, but it seems that a few in the temple of Google are questioning their religious affiliations. OneBox results have been a little sketchy of late. The reason this came to light is that I’ve just looked at 100-plus sessions in Google for a recent study, and there were surprisingly few of those sessions with OneBox results showing.

First of all, they hardly ever show for product-based searches. Try it for yourself. I must have tried over a dozen different common product searches before I got one that returned Froogle results via OneBox. Now why would that be? Well, for one thing, OneBox real estate competes with top sponsored ads, and perhaps advertisers are starting to resent the increased competition in their neighborhood for highly commercial searches. If that theory is correct, it flies in the face of Google’s goal to provide the most relevant results for each query, no matter what the source of the results. Another reason might be that Froogle has never really gained traction as a shopping engine. Maybe Google’s quiet dialing down the rate of appearance of Froogle results on the main page is their way of admitting that these results aren’t adding value to the user experience.

Doing Vertical Right

If you’re looking at a good example of Vertical execution, Yahoo seems to be currently leading the pack with its Shortcuts. The display of vertical results is consistent, and they seem to be one step ahead of the competition in aligning results with user intent.

Here are some examples we saw in a recent study:

One of the tasks given was to research the upcoming purchase of a digital camera. This resulted in a number of related queries being used, ranging from very general (“digital cameras”) to very specific (“Canon Powershot A530”). When these queries were thrown at Yahoo, the engine was able to differentiate and return appropriate vertical results. Broad generic phrases returned vertical results that compared known brands or allowed browsing by features. More specific queries returned links that led to reviews and best prices for that model alone. It was a great example of results matching intent, and we saw the interaction with these results go up dramatically as an example.

One very bright thing that Yahoo does consistently in its vertical listings is provide a 5-star rating scale. It appears for products, some local results (restaurants, hotels) and in various other places. When it comes to attracting our eye, nothing does the trick better than a visual cue that promises ratings. We love lists that sort from most popular to least popular. It’s the paradigm of the consumer researcher, and it’s something that reeks of scent. We saw eyeballs attracted to these icons like search marketers to an open bar (come on, I know many of you are already scoping out the cocktail network for San Jose).

A Vertical Future

I still believe that verticals mark a path into search’s future, but until the engines do better at disambiguating intent, either through personalization, behavioral tracking or just really smart key phrase parsing, they will be relegated to the thin sliver of real estate they currently occupy. Their success in luring users into what Sterling called a “Page 2” vertical experience will lie solely in how well they deliver on intent.

The Rule of Three in Search

First published July 20, 2006 in Mediapost’s Search Insider

Once again, I find myself up to my earlobes in eye-tracking data. I have no one to blame, as I got myself into this mess when I made the well-intentioned but poorly thought out promise to have the first draft of a study done by the time I head out on vacation at the end of the month.

In wading through the sessions (about 420 of them) sometimes new insights rise to the top–and sometimes my eyeballs just roll back in my head as my hands jerk spasmodically on my keyboard and drool runs down my cheek. Luckily, this week it was the former.

In this study, we are looking at interactions with Google, compared to MSN and Yahoo. Recently, one finding in particular seemed to be screaming out to be noticed. Being a compassionate sort of researcher, I listened.

When we looked at interactions with the top sponsored ads, there was a notable difference between MSN, Yahoo and Google. On MSN and Google, the percentage of clicks happening on these top ads seemed to be in line with previous studies done both by us and by others. But the amount of activity on the Yahoo ads seemed to be substantially higher. We started out by looking at first fixations, or the first place people looked on the page, even for a split second. Here, the engines were all in the same ball park, with 83.7 percent of first fixations in top sponsored ads for Yahoo, compared to 86.7 percent for MSN and 80.6 percent for Google.

Then, we looked at where the first activity on listing happened; where on the page did people start actually scanning listings? Google held a good percentage of eyeballs, keeping 12.4 percent of the users, while MSN had a significant defection issue, losing 36.6 percent of the people who first fixated in the top sponsored ads. But Yahoo lost the fewest, with only 5.5 percent choosing to look elsewhere. And finally, Google had 25.8 percent click-throughs on these ads, and MSN had 16.7 percent (yes, this is low, but MSN was dealing with a number of issues at the time of the study). Yahoo led the pack with a 30.2 percent click-through rate. In fact, for the first time ever in our research, a sponsored link (the number one top sponsored) out-pulled the No. 1 organic link, at click-through rates of 25.6 percent vs. 14 percent. This was a complete reversal of the click-through ratios we saw on the other two engines.

For whatever reason, Yahoo’s top sponsored ads seemed to be locking searchers into their part of the results page to a much greater extent than Google and MSN.

Why? What the heck was going on? Better ads? Not really. If anything, Google’s ads seemed a touch more relevant.

Location, Location, Location

Part of it was real estate. Another interesting comparison we did was to look at the percentages of screen real estate devoted to various sections of the page. Yahoo has gone out of its way to make the top sponsored ads the dominant feature on a results page at 1024 by 768 screen resolution. At this size, the ads take up 23 percent of the real estate, compared to approximately 16 percent for Google and Yahoo. This pushes organic listings on Yahoo perilously close to the fold.

And there, as I stared at the screen shots of fully loaded (maximum ads and vertical results showing) Google, MSN and Yahoo results at standard resolution, a possible answer revealed itself. On Google, three top sponsored ads, three OneBox results, and three visible organic listings. On MSN, the same three:three:three presentation. But on Yahoo, there were four top sponsored ads, three vertical results, and just one and a half organic listings were visible.

The Rule of Three

Hmmm, three, three and three. There was something there, niggling in the back of my mind. Quickly, I did a search for the “Rule of Three” and sure enough, there it was. We humans tend to think in triplets. Three is a good number to wrap our mind around, and we see it in all kinds of instances. We tend to remember points best when given in groups of three, we scan visual elements best when they come in threes, and we like to have three options to consider. Think how often three comes up in our society: three little pigs, three strikes, three doors on “Let’s Make a Deal,” three competitive quotes. It’s a triordered world out there.

So is it coincidence that search results tend to be presented to us, neatly ordered in groups of three? I think not. It strikes me that this engrained human behavior would probably translate to the search engine results page as well.

The Ruler-breaker

MSN and Google tend to adhere to the rule of three in their layouts (depending on whether or not Google serves three top sponsored ads). Our choices are conveniently presented in neat trios, with logical divides between each.

Yahoo breaks the rule by tipping the balance in favor of the top sponsored ads. First, it provides four results, not three. Does this mean we need to spend a little more time up in these results, trying to fit one extra one into our limited memory slots? That appears to be the case, with people spending an average of 4.6 seconds in the Yahoo top sponsored results in our study, compared to 2.4 seconds for Google and 1.73 seconds for MSN.

Second, it only gives us one visible organic listing to consider. It breaks our natural desire to have three alternatives, thereby reducing the Promise of Interest for the organic listings. In effect, on the screen of results most people would see on Yahoo, we only have one alternative, the top sponsored ads.

An earth-shaking discovery? Perhaps not. But cut me some slack. I’ve been looking at eye-tracking data daily for three months now, spending about three hours each day looking at interactions with the three engines. I think it’s time I took the three other members of my family on a three-week vacation, during which we’ll be visiting three countries. Wait a minute! Do I sense a pattern developing?