Will Agencies Get Search? Don’t Hold Your Breath

First published November 1, 2007 in Mediapost’s Search Insider

It seems like anytime I have a conversation with anyone who knows search and its effectiveness, we always come back to the same question: “Why don’t more ad agencies and brand advertisers get search?”

Just this week, I was having this conversation. Twice, in fact. One of my pet peeves is an arbitrary allocation of budget to search, with no regard for the objectives of a cross-channel campaign. “We’ll take this pile and give it to television. We’ll take this slightly smaller pile and give it to print. Here’s a small pile for online, and, oh, make sure you take a little bit of that and set it aside for search, because everyone’s telling us we should be doing search.” I guess I shouldn’t be complaining. At least there’s now a little bit left over for search, which is a vast improvement from where we were just a few years ago.

But what this approach does is force your search campaign to be managed to budget, rather than to overall objectives. So we see more restrictive targeting, movement down the tail into longer and more specific key phrases, day parting and flighting, geo targeting and other ways to slice and dice the campaign to get the best quality clicks from the budget available.

Now, there’s nothing wrong with this. It’s called campaign optimization. But it’s often done to keep within an arbitrary budget cap that has no logical reason to exist. I’ve said it before and I’ll say it again. Search dollars should be the first ones in, not the last. Take as much search inventory as you can get. Judge your costs per acquisition not against your top performing keywords, but against your other channels, both online and offline. If even the marginal search traffic is generating a lower CPA, beg, borrow and steal as much budget as you can and top up search. Only then should you move from “pull” (prospects holding up their hands to purchase through search) to “push” (trying to persuade latent prospects to purchase). Only put restrictions on your search campaign if you’re absolutely certain that another channel can exceed its effectiveness.

The Classic Brand Building Gambit

Sure, you say, but what about ‘branding”? That’s TV’s domain. Well, I disagree. I think there’s no better branding opportunity than deep engagement with a Web site from a qualified prospect. Again, this is someone well down the funnel who is considering his or her purchase options. And search drives these opportunities. Sure, TV, print and other channels can build brands, but I challenge anyone to prove to me that they build brands as cost-effectively as search driving Web site engagement. I’ve yet to see a study that shows that. I’ve seen several that show search blowing away other channels, including the CPG study I wrote about last week. Brand-build with prospects that are ready to buy first, then build with the “maybe, someday” crowd with what’s left over.

So, why is it such a struggle to get search on the horizon of big agencies and advertisers? I’ve come to the conclusion that search is being held back by four things:

Search is small. Advertisers and agencies like to think big. They like big, bold ideas. Killer campaigns. Knock-your-socks-off creative. Search is none of those things. Search is thousands of micro-niche campaigns. Search is granular and gritty. Search is turning a whole bunch of dials and pulling a lot of levers, to squeeze out new customers a few at a time. You can’t “unveil” a new search campaign, like snatching a sheet off a sculpture. Launching a search campaign is more like putting a million grains of sand into a bucket, one spoonful at a time. That’s not a concept that “brilliant” advertising minds can get fired up about.

Search is measurable. You can measure the hell out of search. You can hold everyone accountable. You can demand to know who screwed up the campaign because your ROI dropped 10 points. That can cause a lot of red faces round the ol’ agency conference table.

Search is hard. Because search is granular, search is hard. It takes a lot of work to squeeze out an impressive bottom line. And the harder you work, the more impressive that bottom line will be. You’ll never hit a search home run with one inspired brainstorm. There is no golden concept. You just keep plugging away, tweaking keywords and pulling in prospects. Agencies and big advertisers are looking for that single perfect run down the mountain, with fresh powder and the sun shining. Search is more like cross-country skiing up the mountain.

Search is utilitarian. Search is constantly accused of not being sexy. That drives me nuts. The irony is that in pigeonholing search as being boring and utilitarian, all these brilliant advertising minds are missing the biggest idea of all: search works because it’s the customer driving the process, not the advertiser. All you have to do is a half decent job of meeting them halfway. Some say it’s that lack of control that scares the bejeebers out of agencies and brand marketers. To be fair, I don’t think that’s always true. I just think that search just doesn’t get the juices going in the average marketer. It may not be that they’re scared; it may just be that they’re bored.

And for all these reasons, I don’t think big agencies will ever truly get search. It’s too much of a cultural mismatch for them. They’ll bring search in-house, but they’ll silo it off, in a back room, far from the playground which is really where everyone wants to be, cranking out killer creative for the next TV campaign.

It’s just too bad that those TV ads won’t work very well. At least, not when you compare them to search.

 

The Other Long Tail of Search

smallcoverIn 2006 Wired Editor Chris Anderson released The Long Tail, and suddenly we were finding long tails in everything. The swoop of the power law distribution curve was burned on our consciousness, and search was no exception. Suddenly, the hot new strategy was to move into the long tail of search, those thousands of key phrases that individually may only bring a handful of visitors, but in aggregate, can bring more than the head phrases. At Enquiro, we were no exception. But lately, I haven’t heard as much about long tail campaigns. And I think it’s because our thinking was a little flawed.

One of the key elements of a long tail marketplace is that there can’t be a scarcity bottleneck. Shelf space has to be unlimited, production, distribution, etc. The economics of supporting a long tail have to make sense. There has to be little to no overhead in making a vast selection available to the market. The ideal example is digital entertainment. Once an MP3 is encoded, the only overhead for the distributor is a couple of megabytes of storage capacity.

That’s just not true in search management. It takes time to set up a campaign for a keyword. It takes time to organically optimize for it. There’s significant campaign management overhead associated with search. From a resource perspective, search marketing is expensive, and as anyone who’s tried to recruit a search marketer can tell you, there is no abundance mentality at play here. Sure there’s thousands of keyphrases that may potentially bring one or two visitors a month, and if you add them up, it would be hundreds of thousands of potential leads, but we just can’t move from the head to the tail because we don’t have the time.

Engines tried to open up the bottle neck by offering broad match, but results from broad match campaigns are dramatically less than spectacular. In many cases, we needed to go back to the more granular control that comes with exact match to keep performance levels where we needed them to be.

But in perusing some of our spreadsheets from past studies, and with Anderson’s Long Tail curve fresh in my mind, I found another long tail in search. In several studies, we’ve tracked click throughs by position. Look what happens when you take the most popular click through position, the number one organic spot, and then work down by position:

clickthrough tail

As you can see, we have another long tail. Now, due to the scale of the graph, it looks like the tail goes to zero. This isn’t the case, but by the time we get to the second page of results, we tend to hit percentages that are fractions of 1%. As long tails go, this is skinnier than most, showing the power of position on the first page of results.

But now let’s combine the two long tails. If you take the head being a #1 organic ranking for your most popular phrase, and work down from there, the results get quite dramatic. For the sake of this example, I’ll move down one position for each keyword. Here’s a table showing the numbers:

Keyword Volume Position X Click Through % Clicks
#1 46500 Org 1 26.35 12252
#2 38450 Org 2 13.05 5017
#3 32500 Org 3 10.2 3315
#4 23400 Spon 1 8.75 2047
#5 15750 Org 4 5.35 842
#6 12450 Spon 2 4.125 513
#7 8750 Org 5 3.875 339
#8 5250 Org 6 2.875 150
#9 4325 Side 1 2.5 108
#10 2750 Org 7 1.875 51

Now, let’s plot that on a graph:

clickthrough tail2

Given that search is a resource hog in terms of manpower, I argue that we’d be far better working our way up the tail rather than down it. And by moving up the tail, I mean the click through by position tail. By moving up the page, even a position or two, with relatively popular keywords, you can leverage the compounding effect of the two curves and dramatically improve your campaign performance.

Search and the Digital CPG Shelf

First published October 25, 2007 in Mediapost’s Search Insider

Last April, James Lamberti from comScore, Randy Peterson from Procter and Gamble and I (representing SEMPO) grabbed a relatively quiet corner at the New York Hilton to talk about a potential research project. Here was our wish list:

–    A study that tied together online activity to offline purchase behavior
–    A study that identified the impact of search in a category not typically one that would be identified with search marketing
–    A study that would attempt to quantify the leveraged impact of search with brand advocates

Search and CPG: Are You Kidding?

As you can see, these were pretty lofty targets to shoot for. Choosing the product category was done at that table. What is the last category you would think of as generating significant search activity? Consumer packaged goods. After all, aren’t these either replenishment purchases, where we keep buying the same brand over and over, or a non-considered purchase, where we’re not really concerned with doing much research? Why would we need to turn to a search engine to figure out which toothpaste to buy, or which would be the right chips for Sunday’s ball game? We reasoned that CPG had the “Sinatra” Factor going for it: If search can make it here, it can make it anywhere.

To be honest, we really didn’t know what to expect, but comScore, together with a lot of help from Yahoo and Procter and Gamble, managed to come up with a workable study design. SEMPO jumped on board as a co-sponsor and we put the study out in the field. This week, with numbers crunched and charts drawn, the results were released in a study labeled The Digital Shelf. After several months of holding our collective breaths, we were about to see if people had already locked CPG brands into their brains, eliminating the need to search for product information.

Apparently not.

People went online for CPG information — in fact, to a significantly higher degree than even our most optimistic predictions.  Over a 3-month period, comScore recorded over 150 million visits to CPG websites in four categories: Food Products, Personal Care Products, Baby Products and Household Products. Those are numbers no marketer should ignore. But even more significantly, search drove significant portions of that traffic, from 23% of all visits in Household Products to 60% in Baby Products.

It’s not just automotive or travel that drive search traffic. We search for recipes, how to get the stains out of carpets, the most eco-friendly disposable diaper and yes, even the nutritional information for potato chips. We search, a lot!

And our searching sets us apart as a consumer segment. Searchers tend to be more interested in product information, comparing against competitors and what they need to make a purchase decision. Non-searchers are more interested in special offers and coupons.

Searchers spend more, about 20% more  — in all the categories in the study. In fact, in the Baby Care Category alone, people searching for information and eventually purchasing could result in almost $12 billion in sales.

Search = Opportunity

But perhaps the most compelling finding was this: People search because they’re comparing alternatives. This means they’re not locked into a brand. They could very well be your competitor’s customer right now. Non-searchers are more likely to go directly to a site because they do have a brand preference. They’re just looking for a bargain on that brand. The study found that 36% of searchers had recently switched their brand, compared to 29% of non-searchers. And, interestingly, searchers are less motivated by price. Only 27% of searchers switched because of price, compared to 38% of non-searchers.

So, the study delivered on our original wish list, and then some. It showed that search is a significant influencing factor in the most unlikely product category of all, the stuff on your pantry shelf or under the sink in your bathroom. In fact, I have yet to see a study done on any product category where search didn’t blow the doors off the competition in its effectiveness in connecting with customers. So perhaps the biggest question left unanswered by the study is this: Why are all those branding dollars still going everywhere but search?

Personalization Catches the User’s Eye

First published September 13, 2007 in Mediapost’s Search Insider

Last week, I looked at the impact the inclusion of graphics on the search results page might have on user behavior, based on our most recent eye tracking report. This week, we look at the impact that personalization might bring.

One of the biggest hurdles is that personalization, as currently implemented by Google, is a pretty tentative representation of what personalization will become. It only impacts a few listings on a few searches, and the signals driving personalization are limited at this point. Personalization is currently a test bed that Google is working on, but Sep Kamvar and his team have the full weight of Google behind them, so expect some significant advances in a hurry. In fact, my suspicion is that there’s a lot being held in reserve by Google, waiting for user sensitivity around the privacy issue to lessen a bit. We didn’t really expect to see the current flavor of personalization alter user behavior that much, because it’s not really making that much of a difference on the relevancy of the results for most users.

But if we look forward a year or so, it’s safe to assume that personalization would become a more powerful influencer of user behavior. So, for our test, we manually pushed the envelope of personalization a bit. We divided up the study into two separate sessions around one task (an unrestricted opportunity to find out more about the iPhone) and used the click data from the first session to help us personalize the data for the search experience in the second session. We used past sites visited to help us first of all determine what the intent of the user might be (research, looking for news, looking to buy) and secondly to tailor the personalized results to provide the natural next step in their online research. We showed these results in organic positions 3, 4 and 5 on the page, leaving base Google results in the top two organic spots so we could compare.

Stronger Scent

The results were quite interesting. In the nonpersonalized results pages, taken straight from Google (in signed out mode) we saw 18.91% of the time spent looking at the page happened in these three results, 20.57% of the eye fixations happened here, and 15% of the clicks were on Organic listings 3, 4 and 5. The majority of the activity was much further up the page, in the typical top heavy Golden Triangle configuration.

But on our personalized results, participants spent 40.4% of their time on these three results, 40.95% of the fixations were on them, and they captured a full 55.56% of the clicks. Obviously, from the user’s point of view, we did a successful job of connecting intent and content with these listings, providing greater relevance and stronger information scent. We manually accomplished exactly what Google wants to do with the personalization algorithm.

Scanning Heading South

Something else happened that was quite interesting. Last week I shared how the inclusion of a graphic changed our “F” shaped scanning patterns into more of an “E” shape, with the middle arm of the “E” aligned with the graphic. We scan that first, and then scan above and below. When we created our personalized test results pages, we (being unaware of this behavioral variation at the time) coincidentally included a universal graphic result in the number 2 organic position, as this is what we were finding on Google.

When we combined the fact that users started scanning on the graphic, then looked above and below to see where they wanted to scan next with the greater relevance and information scent of the personalized results, we saw a very significant relocation of scanning activity, moving down from the top of the Golden Triangle.

One of the things that distinguished Google in our previous eye tracking comparisons with Yahoo and Microsoft was its success of keeping the majority of scanning activity high on the page, whether those top results were organic or sponsored.

Top of page relevance has been a religion at Google. More aggressive presentation of sponsored ads (Yahoo) or lower quality and relevance thresholds of those ads (Microsoft) meant that on these engines (at least as of early 2006) users scanned deeper and were more likely to move past the top of the page in their quest for the most relevant results. Google always kept scan activity high and to the left.

But ironically, as Google experiments with improving the organic results set, both through the inclusion of universal results and more personalization, their biggest challenge may be in making sure sponsored results aren’t left in the dust. Top of page scanning is ideal user behavior that also happens to offer a big win for advertisers. As results pages are increasingly in flux, it will be important to ensure that scanning doesn’t move too far from the upper left corner, at least as long as we still have a linear, 1 dimensional top to bottom list of results.

Search Engine Results: 2010 – Marissa Mayer Interview

marissa-mayer-7882_cnet100_620x433Just getting back in the groove after SES San Jose. You may have caught some of my sessions or heard we have released a white paper looking at the future of search and with some eye tracking on personalized and universal search results. We don’t have the final version up yet, but it should be available later this week. The sneak preview got rave reviews in SJ.

Anyway, I interviewed a number of influencers in the space, and I’ll be posting the full transcripts here on my blog over the next week. I already posted Jakob Nielsen’s interview. Today I’ll be posting Marissa Mayer’s, who did a keynote at SES SJ. It makes for interesting reading. Also, I’ll be running excerpts and additional commentary on Just Behave on Search Engine Land. The first half ran a couple weeks ago. Look for more (and a more regular blog schedule) coming out over the next few weeks. Summer’s over and it’s back to work.

Here’s my chat with Marissa:

Gord: I guess I have one big question that will probably break out into a few smaller questions.  What I wanted to do for Search Engine Land is speculate on what the search engine results page might look like to the user in three years time.  With some of the emerging things like personalization and universal search results and some the things that are happening with the other engines: Ask with their 3D Search, which is their flavor of Universal, it seems to me that we might be at a point for the first time in a long time the results that we’re seeing may have a significant amount of flux over the next 3 years.  I wanted to talk to a few people in the industry about their thoughts of what we might be seeing 3 years down the road.  So that’s the big over-arching question I’m posing.

Marissa: Sure, Minority Report on search result pages…Well, I’d like to say it’s going to be like that but I think that’s a little further out.  There are some really fascinating technologies that I don’t know if you’ve seen..some work being done by a guy named Jeff Han?

Gord: No.

Marissa: So I ran into Jeff Han both of the past years at TED. Basically he was doing multi-touch before they did it on the iPhone on a giant wall sized screen, so it actually does look a lot like Minority Report. It was this big space where you could interact, you could annotate, you could do all those things.  But let me talk first about what I see happening as some trends that are going to drive change.

One is that we are seeing more and more broadband usage and I think in three years everyone will be on very fast connections, so a lot more to choose from and  a lot more data without taking a large latency hit.  The other thing we’re seeing is different mediums, audio, video.  They used to not work.  If you remember getting back a year ago, everytime you clicked on an audio file or a movie file, it would be, like, ‘thunk’?  It needs a plug in, or “thunk”, it doesn’t work.  Now we’re coming into some standardized formats and players that are either browser or technology independent enough, or are integrated enough that they are actually going to work.  And also we’re seeing users having more and more storage on their end.  And those are the sort of 3 computer science trends that are things that are going to change things.  I also think that people are becoming more and more inclined to annotate and interact with the web. It started with bloggers, and then it moved to mash ups, and now people are really starting to take a lot more ownership over their participation on the web and they want to annotate things, they want to mark it up.

So I think when you add these things together it means there’s a couple of things.  One, we will be able to have much more rich interaction with the search results pages. There might be layers of search results pages: take my results and show them on a map, take my results and show them to me on a timeline.  It’s basically the ability to interact in a really fast way, and take the results you have and see them in a new light.  So I think that that kind of interaction will be possible pretty easily and pretty likely.  I think it will be, hopefully, a layout that’s a little bit less linear and text based, even than our search results today and ultimately uses what I call the ‘sea of whiteness’ more in the middle of the page, and lays out in a more information dense way all the information from videos to audio reels to text, and so on and so forth.  So if you imagine the results page, instead of being long and linear, and having ten results on the page that you can scroll through to having ten very heterogeneous results, where we show each of those results in a form that really suits their medium, and in a more condensed format.  A couple of years ago we did a very interesting experiment here on the UI team where we took three or 4 different designs where the problem was artificially constrained.  It was above the fold Google.  If you needed to say everything that Google needed to say above the fold, how would you lay it out?  And some came in with two columns, but I think two columns is really hard when it was linear and text based.  When you started seeing some diagrams, some video, some news, some charts, you might actually have a page that looks and feels more like an interactive encyclopedia.

Gord: So, we’re almost going from a more linear presentation of results, very text based, to almost more of a portal presentation, but a personalized portal presentation.

Marissa: Right and I think as people, one, are getting more bandwidth and two, as they’re more savvy with how they look at more information, think of it this way, as more of serial access versus random access.  One of my pet peeves is broadcast news, where I really don’t like televised news anymore.  I like newspapers, and I like reading online because when I’m online or with newspapers, I have random access.  I can jump to whatever I’m most interested in.  And when you’re sitting there watching broadcast news you have to take it in the order, at the pace and at the speed that they are feeding it to you.  And yes, they try to make it better by having the little tickers at the bottom, but you can’t just jump in to what you’re interested in.  You can only read one piece of text at a time, and it’s hard to survey and scan and hone in on one type of medium or another when it’s all one medium.  So certainly there is some random access happening with the search results today.  I think as the results formats becomes much more heterogeneous, we’re going to have a more condensed presentation that allows for better random access.  Above the fold being really full of content, some text, some audio, some video, maybe even playing in place, and you see what grabs your attention, and pulls you in.   But it’s almost like random access on the front page of the New York Times, where am I more drawn to the picture, or the chart, or this piece of content down here?  What am I drawn to?

Gord: Right.  If you’re looking at different types of stimuli across the page, I guess what you’re saying is, as long as all that content is relevant to the query you can scan it more efficiently than you could with the standardized text based scanning, linear scanning, that we’re seeing now

Marissa: That’s right.

Gord: Ok.

Marissa: So the eyes follow and they just read and scan in a linear order, where when you start interweaving charts and pictures and text, people’s eyes can jump around more, and they can gravitate towards the medium that they understand best.

Gord: So, this is where Ask is going right now with their 3D search, where it’s broken it into 3 columns and they’re mixing images and text and different things.  So I guess what we’re looking at is taking it to the next extreme, making it a richer, more interactive experience, right?

Marissa: Rather than having three rote columns, it would actually be more organic.

Gord: So more dynamic.  And it mixes and matches the format based on the types of material it’s bringing back.

Marissa: Well, to keep hounding on the analogy of the front page of the New York Times.  It’s not like the New York Times…I mean they have basically the same layout each time, but it’s not like they have a column that only has this kind of content, and if it doesn’t fill the column, too bad.  They have a basic format that they change as it suits the information.

Gord: So in that kind of format, how much control does the user have? How much functionality do you put in the hands of the user?

Marissa: I think that, back to my third point, I think that people will be annotating search results pages and web pages a lot.  They’re going to be rating them, they’re going to be reviewing them.  They’re going to be marking them up, saying  “I want to come back to this one later”.  So we have some remedial forms of this in terms of Notebook now, but I imagine that we’re going to make notes right on the pages later.  People are going to be able to say I want to add a note here; I want to scribble something there, and you’ll be able to do that.  So I think the presentation is going to be largely based on our perceived notion of relevance, which of course leverages the user, in the ways they interact with the page, and look at what they do and that helps inform us as to what we should do.  So there is some UI user interaction, but the majority of user interaction will be on keeping that information and making it consumable in the best possible way.

Gord: Ok, and then if, like you said, if you go one step further, and provide multiple layers, so you could say, ok, plot my search results, if it’s a local search, plot my search results on a map.  There’s different ways to, at the user’s request, present that information, and they can have different layers that they can superimpose them on.

Marissa: So what I’m sort of imagining is that in the first basic search, you’re presented with a really rich general overview page, that interweaves all these different mediums, and on that page you have a few basic controls, so you could say, look, what really matters to me is the time dimension, or what really matters to me is the location dimension.  So do you want to see it on a timeline, do you want to see it on a map?

Gord: Ok, so taking a step further than what you do with your news results, or your blog search results, so you can sort them a couple of different ways, but then taking that and increasing the functionality so it’s a richer experience.

Marissa: It’s a richer experience. What’s nice about timeline and date as we’re currently experimenting with them on Google Experimental is not only do they allow you to sort differently, they allow you to visualize your results differently.  So if you see your results on a map, you can see the loci, so you can see this location is important to this query, and this location is really important to that query.  And when you look at it in time line you can see, “wow, this is a really hot topic for that decade”.  They just help you visualize the nut of information across all the results in these fundamentally different ways that ‘sorts’ kind of get at. But it’s really allowing that richer presentation and that overview of results on the meta level that helps you see it.

Gord: Ok.  I had a chance to talk to Jakob Nielsen about this on Friday, and he doesn’t believe that we’re going to be able to see much of a difference in the search results in 3 years.  He just doesn’t think that that can be accomplished in that time period.  What you’re talking about is a pretty drastic change from what we’re seeing today, and the search results that we’re seeing today haven’t changed that much in the last 10 years, as far as what the user is seeing.  You’re really feeling that this is possible?

Marissa: It’s interesting, you know, I pay am lot of attention to how the results look.  And I do think that change happens slowly over time and that there are little spurts of acceleration.  We at Google certainly saw a little accelerated push during May when we launched Universal Search.  I’m of the view that maybe its 3 years out, maybe it’s 5 years out, maybe it’s 10 years out.  I’m a big subscriber to the slogan that people tend to overestimate the short term and underestimate the long term.  My analogy to this is that when I was 5, I remember watching the Jetson’s and being, like, this rocks!  When I’m thirty there are flying cars!  Right?  And here I am, I’m 32 and we don’t even have a good flying car prototype, and yet the world has totally changed in ways that nobody expected because of the internet and computing.  In ways that in the 1980s no one even saw it coming.  Because personal computers were barely out, let alone the internet.  It’s interesting.  We do our off site in August. I do an offsite with my team where we do Google two years out. There it’s really interesting to see how people think about it.  I take all the prime members on my team, so they’re the senior engineers, and everybody has homework.  They have to do a homepage and a results page of Google, and this year it’ll be Google 2009.

Gord: Oh Cool!

Marissa: Six months out, it’s really easy because if we’re working on it, because if it’s going to launch in 6 months and it’s big enough that you would notice, we’re working on it right now and we know it’s coming.  And five years or ten years out we start getting into the bigger picture things like what I’m talking to you about.  When the little precursors that get us ready for those advances happen between now and then that’s what’s shifting.   So I’m giving you the big picture so you can start understanding what some of the mini steps that might happen in the next 3 years, to get us ready for that, would be.  The two to three year timeframe is painful. Everybody at my offsite said, “this timeframe sucks!” So it’s just far enough out that we don’t have great visibility, will mobile devices be something that’s a really big new factor in three years?  Maybe, maybe not.  Some of the things are making fast progress now may even take a big leap, right, like it was from 1994 to 97 on the internet.  Or if you think about G-mail and Maps, like AJAX applications..you wouldn’t have foreseen those in 2002 or 2003.  So, two or three years is a really painful time frame because some things are radically different, but probably in different ways than you would expect.  You have very low visibility in our industry to that time frame.  So I actually find it easier to talk about the six month timeframe, or the ten year timeframe.  So I’m giving you the ten year picture knowing that it’s not like the unveiling of a statue, where you can just take the sheet, snatch it off and go, “Voila there it is”.  If you look at the changes we’ve made over time at Google search they’ve always been “getting this ready, getting this ready”.  So the changes are very slow and feel like they’re very incremental.  But then you look at them in summation over 18 months or two years, you’re like, “you know, nothing felt really big along the way, but they are fundamentally different today”.

Gord: One last question.  So we’re looking at this much richer search experience where it’s more dynamic and fluid and there are different types of content being presented on the page.  Does advertising or the marketing message get mixed into that overall bucket, and does this open the door to significantly different types of presentation of the advertising message on the search results page?

Marissa: I think that there will be different types of advertising on the search results page.  As you know, my theory is always that the ads should match the search results.  So if you have text results, you have text ads, and if you have image results, you have image ads.  So as the page becomes richer, the ads also need to become richer, just so that they look alive and match the page.  That said, trust is a fundamental premise of search.  Search is a learning activity.  You think of Google and Ask and these other search engines as teachers.  As an end user the only reason learning and teaching works, the only way it works, is when you trust your teacher.  You know you’re getting the best information because it’s the best information, not because they have an agenda to mislead you or to make more money or to push you somewhere because of their own agenda.  So while I do think the ads will look different, they will look different in format, or they may look different in placement, I think our commitment to calling out very strongly where we have a monetary incentive and we may be biased will remain.  Our one promise on our search results page, and I think that will stand, is that we clearly mark the ads.  It’s very important to us that the users know what the ads are because it’s the disclosure of that bias, that ultimately builds the trust which is paramount to search

Gord: Ok.  Great to see you’re a keynote at San Jose in August.

Marissa: Should be fun.  This whole topic has me kind of jazzed up so maybe I’ll talk about that.

Breaking “Auction Order” Explained

One of the things that raised eyebrows in my interview with Diane Tang and Nick Fox was the following section regarding how Google determines which ads rank first and climb into the all important top sponsored locations:

Nick: Yes, it’s based on two things.  One is the primary element is the quality of the ad. The highest quality ads get shown on the top. The lower quality ads get shown on the right hand side. We block off the top ads from the top of the auction, if you really believe those are truly excellent ads…

Diane: It’s worth pointing out that we never break auction order…

Nick: One of the things that’s sacred here is making sure that the advertiser’s have the incentive. In an auction, you want to make sure that the folks who win the auction are the ones who actually did win the auction. You can’t give the prize away to the person who didn’t win the auction. The primary element in that function is the quality of the ad. Another element of function is what the advertiser’s going to pay for that ad. Which, in some ways, is also a measure of quality. We’ve seen that in most cases, where the advertiser’s willing to pay more, it’s more of a commercial topic. The query itself is more commercial, therefore users are more likely to be interested in ads. So we typically see that queries that have high revenue ads, ads that are likely to generate a lot of revenue for Google are also the queries where the ads are also most relevant to the user, so the user is more likely to be happy as well. So it’s those two factors that go into it. But it is a very high threshold. I don’t’ want to get into specific numbers, but the fraction of queries that actually show these promoted ads is very small.

This seemed a little odd to me in the interview and I made a note to ask further about that, but what can I say, I forgot and went on to other things. But when the article got posted on Searchengineland, Danny jumped on it at Sphinn

“Seriously? I mean, it’s not an auction. If it were an auction, highest amount would win. They break it all the time by factoring in clickrate, quality score, etc. Not saying that’s bad, but it’s not an auction.”

This reminded me to follow up with Nick and Diane. Diana Adair, on the Google PR team, responded with this clarification:

We wanted to follow up with you regarding your question below.  We wanted to clarify that we rank ads based on both quality score and by bid.  Auction order, therefore, is based on the combination of both of those factors.  So that means that it’s entirely possible that an ad with a lower bid could rank higher than an ad with a higher bid if the quality score for the less expensive ad is high enough.

So, it seems it’s the use of the word “auction” that’s throwing everyone off here. Google’s use of the term includes ad quality. The rest of the world thinks of an auction as somewhere where the highest bid (exclusively) determines the winner. Otherwise, like Danny said, “it’s not an auction”. So, with that interpretation, I then assume that Nick and Diane’s (which sounds vaguely like a title of a John Mellencamp song) comment means that Google won’t arbitrarily hijack these positions for other types of packages which may include presence on the SERP, as in the current Bourne Ultimatum promotion.

So You Really Want to Integrate Search?

The Ontario tourism board and I have been butting heads a little bit in the blogosphere as of late.  It all came about from an article I wrote a few weeks ago saying that perhaps Canadian advertisers have their “heads up their ass” with search marketing.  I used the Ontario Tourism Board as an example of a major organization that was not doing search and was quickly corrected by Nick Pedota from the board, who indicated that they were in fact doing a search campaign.  My problem was that I couldn’t find them for any of the keywords I thought they would typically appear for.  It seemed to me that there was a disconnect here.  This week I published a follow-up column indicating that perhaps there was a mismatch between the objectives and the allocation of budget in the Ontario Tourism strategy. In a follow-up comment to the column, Nick graciously complemented me on my research and admitted that perhaps there was room for improvement in their integrated search strategy.  My suspicion is that the cracks in the strategy don’t lie exclusively with either the Ontario Tourism board or their agency but likely fall somewhere in between. And it’s not uncommon to find these cracks when major advertisers move into trying to integrate search in their overall campaign strategies.   Kudos are in order for Ontario Tourism’s recognition of search at all.

In the spirit of improvement, I’d like to offer Nick and other marketers a few tips for successfully integrating search into an overall marketing campaign.

Search should be your first dollars in

Typically, search is added as an afterthought in most marketing campaigns.  In fact, search should be the foundation of the campaign.  This should be the first allocation of funds. Searchers are often your best prospects. They’re the ones that are actively involved in trying to find you.  In the case of the Ontario Tourism Board the entire campaign objective was to drive people to their website.  Therefore, it didn’t make much sense to not fully utilize search as a channel and to steer dollars instead to less efficient branding channels such as print and television.

In this case, the first thing that should have been done was to accurately assess the size of the potential search market.  This would’ve been done during the keyword analysis, when the prime keywords were identified and the corresponding search volumes were discovered.  A smart search marketer would be able to determine the key phrases most likely to convert and would start with these, but would then work outwards to determine the total size of the keyword basket. Going hand in hand with this is the determination of the average click cost for these keywords.  The search marketer has to make the determination if the cost per click is justified, given the likelihood to convert.

Once the total available search inventory that meets the quality threshold is established, this should form the core of your marketing budget. These are prospects are raising their hand, indicating that they’re looking to find you.  They should be the first ones captured in your marketing strategy. Then you can extend the campaign with other branding intiatives.

Realize that branding dollars will drive search volume

Even after you extend your budget into areas other than search, quite often the dollars spent here will translate into search activity.  In the case of Ontario Tourism, they ran their website address in all their ads.  But much of this activity would have translated into searches on the primary search engines.  Therefore, you need top of page presence to capture these navigational searches.  Ontario Tourism also did some national advertising, primarily on television, and in this case in particular there is a high likelihood that search would be used to find the site.  Unfortunately with Ontario Tourism’s geo targeting and other limits on maximizing their search presence, it’s unlikely that searchers would be able to find a site to click through to.  So, in effect, you lose two ways here.  You’re spending the money on branding to drive traffic and then you’re not capturing that traffic by ensuring you have an adequate search presence.

Bid on the head words if budget allows

A common mistake with many first-time search marketers is to compare click costs on different keywords against each other, rather than against other lead generation channels.  Head words, the high traffic key phrases that generally form the bulk of the potential traffic, typically cost much more than the long tail phrases.  The neophyte search marketer, in an attempt to be price conscious, often deletes the head words from consideration because of the expense, relative to more niche phrases.  But this is often the wrong comparison.  What the marketer should do is compare the cost per acquisition against the typical cost per acquisition of other channels.  In the case of Ontario Tourism, even their most expensive potential phrases would’ve cost under two dollars per click.  Even under the most optimistic of conversion scenarios, much of their print advertising would have been costing 15 times that.  It was a false economy to delete the head words from the budget consideration, as it would’ve closed the loop on their search strategy and ended up bringing highly qualified prospects at a much lower cost per conversion than their other channels. If you’ve truly allocated as much as possible to your search budget and the head words are still not within reach, then bidding on long tail phrases is really your only option.  But until you’ve made sure that you’re putting your first dollars in the search, don’t eliminate the head words from consideration.

Remember, if it isn’t clicked you don’t pay

It’s typical to use targeting extensively to make sure that traditional marketing is aimed at the right prospects.  You would pick your media channels based on their target demographics.  Often, this thinking is transferred into search but again this could prove to be a false economy. Ontario Tourism decided to use geo targeting to target their primary markets, which was the province of Ontario and the neighboring US border states.  They also put budget caps in place and put time parameters on their campaign. All of these moves would have made sense if budget were extremely limited.  It always makes sense to buy your best clicks first.  But as I mentioned above, in this case search should have been the first dollars in and this would’ve allowed Ontario Tourism to extend their search campaign to capture all of the potential traffic.  One of the beauties of search is that you can gain visibility with relatively little risk.  Unlike television or newspaper advertising, you only pay in search if the ad is clicked.  This eliminates much of the risk and allows you to relax your targeting to ensure that you’re capturing all the potential search traffic.

Understand the visibility dynamics of the search results page

Another source of false economy is the position you choose to occupy on the search results page.  There is generally five times the interaction with ads in the top sponsored position as opposed to ads on the right rail.  And in the case of Ontario Tourism, the official tourism site for the province of Ontario, this would be a site you would expect to see in the top sponsored ads for searches like Ontario vacations. By reinforcing this inherent trust with eye catchers like “official site” the Ontario tourism board would have been able to take advantage of quality scoring to reduce their bid price and maintain their top position. They would also have to use a close variation of the actual key phrase in the title to reinforce information scent. This relevance should, of course, carry through to the landing pages well.  This was an area that could lead to substantially increased conversions for the Ontario Tourism Board as well.

I embarked down this path in order to wake up Canadian advertisers and hopefully make them smarter about integrating search into their strategies.  It’s in that spirit that I offer these suggestions for those that are looking to seriously tap into the potential of search.

The Cranky Canadian is Back from Toronto

Apparently I stirred the pot a little bit when I was in Toronto. Yahoo invited me to give a breakfast talk to the handful of Canadian advertisers and I managed to hijack the session for 10 to 15 minute rant about how Canadians don’t get search.  I quickly followed this up with a column in  the SearchInsider to the same effect. I did make one mistake.  I did mention that the Ontario government doesn’t do search for their official tourism information site.  I was quickly corrected in that.  There is in fact the search campaign going on.  It just wasn’t registering for any of the searches I did.  I think I’ll follow up on this a little more for next week’s SearchInsider column.

I apologize to show chair Andrew Goodman for breaking the cardinal Canadian rule of politeness.  Andrew is shipping a case of generic cola with a Canadian politeness serum cleverly mixed in to try to return me to the accepted norms for Canadian behavior. I noticed another blogger who picked up on my rant indicated that as a Canadian living in the US, I would be well advised to escape back south of the border. I don’t know if this is good news for Canadian advertisers or not, but I actually am a resident Canadian.  I call Kelowna, B.C. home.

You know, the funny thing is, other than poor Nick at the Ontario Tourism Board who I mistakenly said had his head up his ass, most everyone else has agreed with me.  Perhaps being a cranky Canadian pays off.  To my knowledge there’s nobody who really is filling this role currently, although Canadians have a long tradition of being cranky.  Notable cranky Canadians in the past included Gordon SinclairPierre Berton and Jack Webster.

If it makes you feel any better, Canadian advertisers weren’t  the only ones I turn my sights on in the past week.  I also took a few shots at Yahoo during an interview on Bloomberg TV. Maybe it’s the fact that I’ve been traveling for past 2 1/2 months and I think the last time I actually got seven hours of uninterrupted sleep was back in March. This weekend I think I’ll have a stiff shot of Canadian whiskey (we call it rye up here), have a good night’s sleep and maybe I’ll come back next week kinder, gentler and more polite.  Or not.

Canada, It’s Time to Clue into Search!

First published June 14, 2007 in Mediapost’s Search Insider

I’ve never hid the fact that I’m Canadian. I’m fervently proud of that fact, and more than willing to take the good-natured ribbing I often get on the road from my American friends. I usually bear the brunt of some Canadian joke on a panel (often, I’m the one telling it) and I’m more than happy to act as a one-person tourism bureau. But this week, at SES Toronto, I’ve got to say that when it comes to search marketing, Canadian advertisers have their heads up their ass.

Being a Canadian, I’ve pondered long and hard about whether to soften that comment. After all, heaven forbid it comes off sounding rude. Saying someone, anyone, especially your fellow countrymen, have their heads up their ass sounds so, well, American. It’s unequivocal, to the point, in your face, aggressive: everything that Canadians generally aren’t. We’ve had it bred and/or frozen out of us.

But after looking at the facts, I couldn’t come to any other conclusion. The irony is that Canadians (I hope myself included) have played a major role in shaping the North American search industry. People like Barbara Coll, Todd Friesen, Andrew Goodman, Ian McAnerin, Ken Jurina and Jim Hedger are considered world-class in the game. But most of us are shaping the industry working with American clients. It’s because Canadian advertisers haven’t woken up to search yet, and there’s just no excuse for that, because Canadian customers are light years ahead of them.

Canada’s wired!

Canadians use the Internet more than anyone else in the world. According to comScore (responsible for all the stats in this paragraph), we spend more time online, have more wired households, are more sophisticated in our online behavior, do more searches. Pick your metric, Canada is ahead of the pack when it comes to online usage. For example, when we look at average hours spent online per month, Canadians are top with 40 hours, followed by Israel with 37.4 and South Korea with 34. The U.S. is in 8th place with 29.4. Canada also leads the pack in online reach, with 70% of households wired. This time, the U.S. comes in second with 59%. Average pages viewed per visitor? Canada comes in tops with 3800. The U.K. is second with 3300 and the U.S. clicks in with 2500.

See a pattern emerging? We spend a hell of a lot of time online up here. And much of that time is looking for something to buy. Canadians are the world’s best shoppers. We research every purchase down to the nitty-gritty detail. The Internet was created for shoppers just like us.

But what about the advertisers?

I’m writing this at SES Toronto. By common consensus with most Canadian search marketers I’ve talked to, Toronto seems to be the epicenter of the orifice that Canadian advertisers have lodged their collective heads in. The city doesn’t get it, the province doesn’t get it, the country doesn’t get it. When it comes to search, Canada (with a few exceptions) is clueless.

I remember my first SES in Toronto. I had been attending the U.S. shows for a few years previously, and it was with more than a hint of nationalistic pride that I attended the first Canadian show. But my jaw soon dropped at the questions I was fielding from the audience. This group was at least three years behind the U.S. market. That was four years ago. Since then, the U.S. has dramatically outpaced Canadian growth in search savviness. And if you look elsewhere, almost every market I’m familiar with, including the U.K, France, Italy, Germany and even China is rapidly gaining on the U.S. But Canada still seems to be blundering its way forward, overlooking the fact that Canadians spend a huge amount of time online using search engines. It’s to the point where it’s unforgivable.

Show us the money!

Here are just a few of the stats I pulled from comScore, Yahoo Canada and other sources:

  • Canadians spend $28.05 in online advertising per Internet user. The US spends $71.43.
  • 21% of Canadians media usage is online, but it gets 6% of the budget.
  • In contrast, newspapers and magazines get a 7% share of total media usage, but capture 42% of Canadian ad budgets,
  • The U.S. spends almost twice as Canada per capita on search marketing.

I did a few searches from my hotel in Toronto to see if the big brands show for common searches. They don’t. The quality of sponsored ads up here is abysmal. If you were planning a vacation in Ontario, don’t expect to see the official tourism site for the Ontario government in the top sponsored ads. They don’t do search. If there’s anything our research has shown, it’s that you need relevance in top sponsored to encourage interaction with this real estate. Until you get quality advertisers, sponsored is No Man’s Land.

So, in an atypical move for a Canadian, I’m railing against the cluelessness of our advertising community. Next time I come to Toronto, you’d better have your act together. Canadian shoppers get it, why don’t you?

By the way, sorry if this sounds harsh. Must be all the time I’m spending out of the country. Hopefully my passport won’t get revoked.

Planning for Personalization

First published June 7, 2007 in Mediapost’s Search Insider

I should have known as soon as I saw the speaker roster. Google’s Matt Cutts, Yahoo’s Tim Mayer, Atlas Web Service’s Michael Gray and myself on the same panel. Guess who got the lion’s share of attention in the Q&A and after-session scrum? Michael and I might as well have checked out early and hit the Google Dance before the crowds.

The title of the panel at the inaugural SMX in Seattle was “Search Personalization: Fear or Fear Not.” (Discussed from an attendee’s point-of-view in yesterday’s Search Insider.) As moderator Danny Sullivan often does, he set the panel up to generate a little debate: Michael Gray vs. Google, Yahoo vs. Google. I was like Switzerland, in neutral territory. Danny did get his conflict, with Michael taking a few shots at Google and Tim Mayer throwing down the gauntlet about the lack of transparency on Google’s personalized search results.

Guess What? SEOs are not your Average Search User!

To be honest, I was a little taken aback that the audience didn’t jump all over how personalization was going to change SEO. Most of the questions from the crowd centered on how you opt out of personalized search and why personalization wasn’t good for them. I have some issues with that, which of course I’ll share in this column:

  • First, this crowd was trying to argue from a user’s point of view. Okay, they’re SEOs (this was the organic track) and most of them have been using search since Lycos was a little baby spider. Just how typical do you think these users are?
  • Second, I question their motives. Do they hate personalization as a user, or as an organic optimizer? My guess is the latter, but it doesn’t seem very noble to joust with Google because the company is making your job harder. Far better to cry foul as a user than as a PO’d organic optimizer. As somebody said to me after the session, do you really think Marissa Mayer is losing sleep because the Google user experience for SEOs isn’t all the SEOs want it to be?
  • This was a perfect opportunity to start planning for the new world of SEO, post-personalization. There’s a ton of value we can add, as smart, proactive practitioners, but I didn’t see anyone take the opportunity to delve into this. Perhaps the really smart ones were keeping their mouths shut, content to let their competitors bitch about the inevitable while they plotted their takeover.
  • I found everyone fixated on the current threshold of personalization on the page, taking comfort in the fact that it’s only impacting a small number of searches. I reminded them that this threshold is a totally arbitrary one set by Google, and could (and will) change at any time.
  • Everyone is taking a siloed view of personalization, looking at the organic results in isolation. It’s almost as if they’re assessing the amount of damage control required. I’m not sure they realize the import of personalization. This is a rule changer, a paradigm-shifter. This is the new generation of search functionality. It changes the game dramatically. Whatever happens on the organic side will roll over to the sponsored side. It will drive universal search. It will drive everything.
  • Finally, this is not happening just on Google. Microsoft’s recent comments made it very clear its strategists are thinking long and hard about personalization. Tim Mayer cautioned me not to make the mistaken assumption that just because Google was first out with personalization, it’s the only one working on it. In fact, Matt was quite delighted when he found an article in Times Online discussing how Yahoo Vice President Tapan Bhat confessed at the Next Web conference in Amsterdam that personalization was the future of the Web, including search. You can define personalization in a number of different ways, but however you do it, it dramatically changes our online experience.

So, I leave you with this. I went into the SMX session ready to discuss four fundamental changes I see emerging from personalization that SEOs and SEMs have to think about, right now. No one asked me for the slide deck after the session. There was not one question about strategies for leveraging personalization. Everyone was more interested in grilling Matt on why the opt-out link had disappeared from the results page.

Although I’m tempted to join the smart and silent search marketers, I think I’ll make one last attempt to share this information with the SEM/SEO community — perhaps in a white paper, perhaps a future column. But I’m only going to do it if you’re serious about pushing the envelope into this new opportunity. Reply to the blog below and let me know. Otherwise, I’ll just shut up and nod my head while you bitch about the fact that it’s too hard to opt out of personalized search. You’ll excuse me if I don’t answer; you see, my mind is on something else.