Brain Numbing Ideas on a Friday Afternoon

I can’t help but get the feeling that when we look at online marketing, we tend to get blinded by the technology and lose sight of what’s really important: how it affects people.

Right now there’s a flurry of attention surrounding YouTube because of copyright issues and other factors.  And YouTube isn’t alone in this.  The majority of things I did in my in box focus on technology.  What will be the next killer platform?  I see mobile search, I see online video, I see social networking. It’s hard to keep your finger on the pulse of what’s really important.  I find it useful to step back a little bit and see how these things affect real people: people not like you and I, who are caught up in the promise of technology, but people like my daughter’s principal, people like my mom, people like my next-door neighbor.  People who are wary about technology and who will only embrace it if it makes their life better in some way.  This is not to discount the importance of technology, because it truly has turned our lives inside out in the last decade.  But there’s a distillation, a time when we have to get comfortable with change.  The dotcom boom and bust was not because of the lack of technology or its inadequacy.  To technology all things are possible.  But to people, it’s all about what’s in it for me.  And that, ultimately, is the success factor that has to be considered in all this.

So, is YouTube hot?  Is online video hot?  Is social networking hot?  All these things are, but not because of the technology that lies beneath, but rather because of the social change that they empower.  Consider online video for example.  A couple of items in my in box talked about how, at this point, we won’t watch television online.  Even the person at Google who was responsible for online video admitted that at this point, even with Google’s tremendous resources, online video at the quality that we’ve come to expect is not a scalable proposition. 

We interact with video in a far different way online.  For example, YouTube is all about the viral spiral.  It’s all about that cute little two to three minutes of video: something that is either funny or outrageous or awful.  There’s no tremendous requirement for engagement for this.  YouTube is the repository for a million different “in” jokes.  It’s the basket where we collect what titillates the fancy of our collective consciousness at any given time.  It gives us an easy reference point so we can take what interests us and forward it to others if we think they are interested as well.  We’re not ready to watch a one or two hour documentary on the web, simply because we’re not used to interacting with our computer screen in that way.  Our computers are things we do things on, not things we watch passively.  A commitment of two to three minutes to watch a little video screen is fine, but we don’t look to the Web for passive entertainment.  That’s not to say we won’t, some day, as connectivity and convergence moves our channels beyond the current paradigm and as we evolve and learn to interact with them in new ways. 

And it’s there that we start to pick apart at what truly makes technology, at least as far as it’s manifested on the web, really interesting.  It stitches together the fabric of our society.  It’s a synapse that allows our collective brain to fire more effectively than it did before. Communications can zing back and forth between us at a far faster rate.  What we find interesting, what we find intriguing, what we find funny, what we find painful to watch is now available for anyone to see.  It’s cataloged and categorized for our convenience.  It occupies a finite space in the virtual world that we can point to and say, “Look at this, it impacted me and I think it will impact you to.”

I recently had the opportunity to watch Dr. Gary Flake from Microsoft talk.  He started his presentation with the claim that the information technology revolution that we’re currently in will be more significant, as far as the change factor for our society, than anything that has gone before.  More important than the Industrial Revolution, more important than the invention of the printing press, more important than television.  To me the real power of the Internet is that it’s rewiring our society in ways we could never dream of and in ways we never anticipated.  To focus on the wiring or the technology of the Web is to take the mechanic’s view of the world.  To a mechanic or a car buff, a vehicle is a wonderful thing because of the internal combustion engine, because of the horsepower and how fast it can go from zero to 60.  They focus on what it is.  But when you look at how the automobile has affected our society, it’s not about what it is, it’s about what it does.  The automobile brought the world closer.  It allowed us to travel and see new things.  It allowed us to live in one place and work in another.  The macro change that the automobile engendered had nothing to do with how an internal combustion engine worked, it came from moving people from one place to another quickly, cheaply and efficiently.  It mobilized our society in a way that never existed before.

Likewise, the Web is not powerful because of Web 2.0 technologies, or speed of connection, or the ability to host video.  It’s important because it connects us in new and different ways.  It moves power from where it was stuck before into new hands.  It breaks down existing power structures and distributes that power amongst all of us.  It puts the individual in control and allows one individual to connect with another, freely and without paying a poll to the previous power brokers.

The really interesting thing about the Internet is the underlying social current, the groundswell of change that is redefining us and how we live together.  These fundamental factors are exerting a tremendous force within our day-to-day lives.  They’re precipitating change so fast that we haven’t been able to step back and see what the full impact to us will be.  We can’t see the trickle down effect of the things that are happening to us today.  The Internet is changing the very DNA of our society, and we are unable to take a long-term view of what those current mutations will mean for us.  One only has to look at the generational difference between the 45-year-old parent, myself, and my 13-year-old daughter, the first generation that has been fully immersed in online technology.  She interacts with the world in a completely different way.  She searches for information in a different way and evaluates it differently.  She takes these things for granted because she’s never known any other way.  What happens when this entire generation emerges as the shapers of our society?  What happens when they take control from us, with their innate understanding of what the Web makes possible, and redefine everything?

Here are three things that I believe are the foundations of social change being pushed by the Internet:

Access to Information

The amount of information we currently have access to is mind-boggling.  Never has so much raw information lived so close to us.  You can now think about any given topic in the universe of our consciousness, and that information exists just a mouse click away.  And, as the saying goes, information is power.  It empowers each one of us to take a more active role in our destiny.  This information has completely changed how people buy things.  It’s completely changed the relationship between vendors and buyers.  More and more, we go direct to the source, as educated, knowledgeable buyers who know exactly what we want and what we will pay for it.  The challenge on the Internet is that not all information is created equal.  There’s good information and there’s bad information.  However, we are becoming extremely good at being able to differentiate between the two.  We’re becoming amazingly adept at being able to recognize authenticity and we can sniff out BS.  In picking through the multiple threads of information that are available to us out there, we can recognize the scent of truth and quickly discount hype, spin and sheer lies. 

Again, as we begin to recognize the shifting of power to the consumer, the full impact has not shaken out yet.  When we can buy anything online, quickly, easily and confidently, will what will that mean for the entire bricks and mortar retail world out there?  Will there be shopping malls in 20 years?  Will there be stores at all?  Will we buy directly from the manufacturers, cutting out distributors, wholesalers and retailers?  Or will distribution of products to the world of consumers lie in the hands of a few mega, long tail retailers such as Amazon?  I certainly don’t know, the future is far too murky to be able to peer down this path.  And I don’t think it’s important to be able to predict the future, but I do think it’s vitally important to consider the quantum change that is likely in the future.

Searchability

As the amount of information available to us continues to multiply exponentially, the ability to connect with the right information at the right time becomes more and more important.  I’ve always maintained that search is the fundamental foundation of everything that will transpire online.  It is the essential connector between our intent, and the content we’re looking for.  But more than just the connector, the sheer functionality of search, both as it is today and as it will be in the future, creates another catalyst for change in our society. 

We are becoming used to having the answers just a few mouse clicks away.  We are becoming a society of instant gratification.  In the past, we accepted that we couldn’t know everything.  In divvying up the world’s knowledge, some of us were experts in one area and some of us were experts in another.  Some of us were experts in nothing.  But we held no pretensions that we would become experts in areas where we had no previous experience.  There was no path to follow so there was no reason to start the journey. 

But today, you can become an instant expert in anything, depending on how you define the scope of that expertise.  Within 30 seconds I can tell you every movie that Uma Thurman ever appeared in.  I can look up a medical condition and have access to the same information, likely more information, that a doctor 20 years ago would have access to, based on his own experience, education and reference materials.  But again, what is the impact of this?  Does having access to the information about a medical condition makes me an expert in treating that condition?  I have the information but I have no context in which to apply it.  As we gain access to information, will we use that information wisely without the experience and domain expertise that used to accompany that information?

And how will instant access to information alter education in the future?  I remember hearing an observation that if we had a modern day Rip van Winkle, who had gone to sleep 20 years ago and suddenly woke up today, the one place he would feel most comfortable would be in the elementary classroom.  While the outside world is changed dramatically in the past 20 years, the classroom in which your child spends the majority of their day has changed very little.  When I help my children do their homework, there isn’t much difference between the textbooks and the worksheets I see today and the ones I saw 30 years ago.  I recently had to explain to my daughter’s principal the difference between a Web browser and a search engine.  The classroom is like a backwater eddy in the rushing torrent of technological change that typifies the rest of the world.  And it’s not just elementary school where this is an issue.  We often speak to students who are currently going through marketing programs at the university level and are always aghast at how little they’re learning about this new world of marketing and the reality of consumer empowerment.  They’re learning the rules of a game that changed at least a decade ago.

So to bring the point home once more, what will the organization of the world’s information mean for our society?  As search gets better at connecting us to the content that we are looking for, what are the ripple effects for us?  Will our children’s and grandchildren’s brains be wired in a different way than ours are?  Will they assimilate information differently? Will they research differently? Will they structure their logic in a different way?

Creation of Ideological Communities

The Web has redefined our idea of community.  It used to be the communities were defined along geographic lines.  You need a physical proximity to people in order to create a community because physical proximity was a prerequisite for communication.  Communities could exist if there was two way communication.  That’s the reason why community and communication are extensions of the same root word and concept. 

Perhaps the most powerful change introduced by the Internet has been the enabling of real, two way communication between people where physical proximity was not required.  Consider the chain of events that typifies online interaction.  You become aware of someone who shares an ideological interest, usually through stumbling upon them somewhere online.  You initiate communication.  Depending on the scope of your shared interest, you may create the core of the community by inviting others into it.  The Internet gives us the platform that allows for the creation of ideological communities.  We see this happen all the time on properties such as YouTube or MySpace.  Ideological communities are created on the fly, flourish for awhile, and then fade away as interest in the idea that engendered them also fades away.  The Internet, at any given point in time, is a snapshot of thousands, or perhaps millions, of these ad hoc ideological communities.  They form, they flourish and then they disappear.

But in our real world there was physicality to the concept of community.  The way our world is built, our political boundaries, come from physical considerations.  There are distinct geographic boundaries like mountain ranges, oceans and rivers that, in the past, prevented the flow of people across them.  Because of the restricted ability to move, people spent long enough together to share ideals and create communities.  As time moved on these communities became larger and larger.  Transportation allowed us to share common ideals over a greater expanse and nations became possible.  The more efficient the transportation, the larger the nation became.  But throughout this entire process, the concept of geography defined communities and defined nations.  Our entire existing political structure was built around this geographic foundation.

With the Internet, geography ceases to have meaning.  It’s now a virtual world, and I can feel closer to someone in China with whom I share one particularly strong mutually held belief then I might with my next-door neighbor.  More fundamentally, I can belong to several different communities at the same time.  Again, the restraint of the physical world usually restricted the number of interests we had that we could share with those immediately around us.  Our sphere of interest as an individual was somewhat dictated by the critical mass each of those interest areas had within the community in which we lived.  If we thought particularly strongly about one interest we could physically move to a community where there were more people who shared that interest.  So we tended to move to communities that felt “right” ideologically as well as physically.  But with the Internet, does that need for ideological “sameness” where we live eventually disappear?  Does our physical need for community decrease as our ideological need for community is fulfilled through the Internet?

And, if this physical definition of community begins to erode, what does that do for the concept of nationhood and all the things that come along with it? Increasingly, communication and commerce travel along lines not defined by geography.  The idea of a nation, as we currently understand it, is inextricably bound to the realities of geography.  Politics, trade, laws and defense are all concepts that are rooted in thinking developed over the past several centuries.  In the past 30 years we’ve seen the erosion of the concept of nationhood through the creation of common markets and free trade areas.  The very breakdown of the Soviet Union comes from the inability to isolate the population from the concepts which flourished in the free world.  And that was before the Internet ever became a factor.  What happens when we take this movement, already afoot, and add the tremendous catalyst that is the Internet?

It’s in these macro trends that the true power of the Internet can be seen.  It’s not about an individual technology or even the cumulative power of all the technology.  It’s about how the sum of all that affects us as individuals, how we interact with the world around us and how we connect with other individuals.  The seeds have been planted, we can’t turn back, and we can’t foresee what will be.  The world is evolving and truly becoming a global community.  We are entering a time when change will accelerate faster than our society may be able to keep up.  There will be costs, certainly, but my hope and belief is that the rewards will far outweigh the costs.

Personalized Search Brouhaha

Predictably, Google’s announcement late last week about pushing more users to personalized search results has created a lot of buzz in the blogosphere. There’s a lot of “what the hell does this mean” questioning going on out there. This will continue for the forseeable future as more engines move down the personalization road.

Normally, I’d be right in there swinging, but I have been on vacation this week, so I’m somewhat looking from afar. However, I do think that we can debate personalized search all we want in the SEM/SEO circles, but Google is going to do what Google is going to do. So, to that end, I’m reaching out to the two people who really have a say in this. Matt Cutts and I have been chatting about this for some time, but Matt wanted to defer an official interview until later this month (due, no doubt, to the timing of Google’s recent accouncement). I’m just confirming a time with Matt now. More details on this soon.

The other person I need to speak to is Marissa Mayer, on what this means for the Google search experience. Again, the wheels are in motion and I’m hoping to jump on this as soon as I get back (next week, reluctantly–I mean reluctantly returning to work, not reluctantly interviewing Marissa, which is always a delight!).

Which leads me to a lot of the buzz that’s currently happening. There’s a lot of talk about user experience. Honestly, most of the opposition I’ve heard to personalized search results are coming from SEO’s, and I have to question whether their motives are pure as they take up the UI banner here. Graywolf has been one of the most prolific critics, including posts on my blog. Here was one:

Let’s take personalized SERP’s a bit farther, let’s imagine we have something like digital books that can rewrite themselves based on user preferences. Instead of Hermione Granger being a brown haired slightly bookish student at Hogwarts, she’s a buxom blonde in a mini-skirt because I’ve demonstrated a preference for that in the past. For someone else she’s a raven haired gothic princess, for another she’s more of a debutante prom queen.

Sure the example is bit over the top but that’s not that far in concept to what they are doing. The top 10 listings in a SERP are pretty similar in concept to the main characters of a book, making them different for everyone is like having a different book for everyone.

Not sure I get the analogy here. It’s a stretch to try to compare SERP’s with a book. It doesn’t work on a number of levels. The average person spends a few seconds on a SERP, several hours with a book. And the goal is to spend as little time as possible on the results page.

Also, the nature of engagement is totally different. I’m looking for one link, the best one, on a SERP, not delving into the nuances of a character, whatever her appearance.

I do agree that Google is making it more difficult to know if you’re signed in, which is not ideal, and the current level of personalization is pretty watered down, but ultimately if personalization increases relevance to me, that’s a good thing.

Here are the challenges for Google in the personalization path they’re going down. Right now, the introduction of a few organic listings doesn’t really make a significant difference for the user. To significantly change the user experience, someone has to be bolder with personalization. And that means you have to be pretty confident that you’ve disambiguated intent. Google currently uses sites you’ve visited in the past as the indicator. As Danny said in his post, the net effect of this is your own sites, which you visit regularly, will enjoy a boost but other than that, I don’t really count this as personalization, at least not to the level I want.

What if you use the immediately preceding clickstream, as in behavioral targeting? What if you start identifying themes in the clickstream data and become bolder in grouping related search suggestions. What if you do, as Marissa Mayer suggested in her interview with me, and start mixing in contextual relevance based on your current task, as determined by Google desktop search or another Google plug in. And what if you use all this to drop the user into a much richer experience?

Let me give you an example. I’m currently on my way to Kauai, Hawaii. I’ve been doing a lot of searching for things to do, especially in the area around our hotel in Lihue. We’ve been looking for family beaches, places to go snorkeling, places to rent a bike, local events in the time frame we’re there, etc. This could have all been captured in my search history. Now, let me go to Google and launch a search for Kauai Restaurants. What would be cool is if Google presented me with restaurants close to my hotel, preferably with maps. Also, it could suggest other geographically targeted results or suggested searches. That’s personalization.

I do believe Google needs to allow users to toggle any type of customized results, with clear controls. One of the current user issues I have with Google is their transparent geo-targeting of results in Canada. When I search using a non-geographically specific query, as in “search engine marketing”, I see different results in Canada than I would in the US, favoring sites based in Canada. But 99.9999% of users in Canada would never know this, as there is nothing on the results page to indicate this. I only know it because we need to see results as they appear on both sides of the border and so use US based proxies a lot to fool Google into thinking we’re searching from the US.

For a lot of searches from Canada, it probably makes sense to push Canadian based sites higher in the result set, but for others, it doesn’t. Whatever the search, Google needs to be clearer when they filter results based on a criteria the user might not be aware of, such as personalization or geographic location.

For the search user experience, it comes down to two significant issues, and whoever can do this best will win:

Relevance Aligned to Intent: I’ve always said that search is the connector between intent and content. The more successful you can make that connection, the better. Take my intent and by whatever means necessary, personalization, demographic targeting, behavioral targeting, social targeting, give me links to the content I’m looking for. Be the best at doing that and you’ll win. And you simply can’t do that with universal search results. Personalization is inevitable.

User Control: If I have a quibble with what Google is doing, it’s in the taking control from the hands of the user. What we don’t want here is the “Google knows best” attitude that the company has been guilty of in the past. Always leave clear options for the user to navigate and tailor the results to their preferences. If you go to personalized results as a default, indicate how the user can toggle the option on and off.

We can debate whether personalization is a good or bad thing. Honestly, I think it’s a moot point. The next generation of search is impossible without personalization, in one form or another. In three interviews with usability people at Google, Yahoo and Microsoft, when I asked them about the biggest challenge to overcome, they all pointed to getting away from the current paradigm of a query box and a standard set of results. Everyone acknowledges that search is in it’s infancy. By saying that we shouldn’t go down the personalization path, it’s like saying we always want our baby to remain 9 months old. Sure, they’re easier to control at that age, but it makes it a little difficult for them to realize their potential as a human being.

The Personalized Results are Coming, The Personalized Results are Coming!

Okay, sometimes the temptation to say I told you so is overwhelming. Danny has a nice long post in Searchengineland about Google’s changes to Personalized Search, making it more of a default and less of an option for millions of users. Danny details it more than I intend to, so please check it out.

As Danny says, he’s been talking about personalization for years, but up to now, it never materialized. After interviews with head user experience people at all three engines, I felt the time was right for personalized search to roll out (check The Future of SEO in a Personalized Search Interface and The SEO Debate Continues). And it appears my sense of timing was bang on. Much as I’d like to claim to be prescient, it’s really just common sense. You could see all the engines inching towards it. Now, Google has just upped the ante a little.

There are two major implications to this: what it means for search marketers, especially organic optimizers, and what it means to users. I’ll deal with each in turn.

What it Means for Search Marketers

The “Is SEO Dead? Rocket Science? A Scam?” Debate has been winding it’s weary way through several blogs in the past few weeks. My take was that SEO is, and will continue to be, vitally important as long as organic search results continue to be important to the user. Based on what I’m seeing, that continues to be very much the case. But, organic optimization now has a completely new rule set, which will irritate the hell out of many organic optimizers. The disgruntlement is already beginning to show. Michael Gray, better known as Graywolf, was the first to post a comment on Danny’s story:

Just because I ordered my coke with extra ice last time doesn’t mean I want it that way this time. I hate personalized SERP’s, I despise it even more that they don’t tell me they are personalized, and I loathe not being able to turn it off. I also have extreme antipathy for not being able to keep my search history on and not be part of personalized search.

Let me have it the way I want, not the way you think I do. I don’t want SERP’s that work like Microsoft programs that try to anticipate what I want to do, because more often than not it’s wrong. Bring back truth, purity, and clarity to the SERP’s.

Graywolf is complaining as a user, but I can’t help thinking that the more significant pain he’s feeling is as an organic optimizer who’s world suddenly just became a lot more complicated. “Truth, purity and clarity to the SERP’s”? In whose eyes? Come on. Personalization is being implemented because it enhances the user experience. It doesn’t take a “Rocket Scientist” (sorry, couldn’t resist) to see that one set of search results is not the best way to serve millions of users.

As Danny said, there’s now an explosion of new fronts for the organic optimizer to consider. Right now, Google is only injecting a few personalized results into the search page, but expect that threshold to gradually creep up as Google gains confidence in the targeting of the results to the person. The days of the universal results page are numbered. Which means that the days of the reverse engineering approach to SEO are equally numbered. I’m sure people will try to figure out ways to spam personalized search, but as I’ve said before, reverse engineering requires a fixed constant to test against. Up to now, the results page and the other sites that appeared on it represented that fixed constant. That’s gone now.

So where does that leave SEO? Well, it’s certainly not dead, but it has dramatically changed. You can’t optimize against a results set, but you can optimize against a user. Let’s use an analogy that’s often been used before to describe SEO. Think of it as Public Relations on the Web. If you launch a PR campaign, you don’t target a particular position on the front page of the NY Times, you target a type of audience. You plan your release distribution and messaging accordingly. And you give reporters what you think will catch their attention. Most of all, you have to wrap your campaign around something that’s genuinely interesting. Then, you hope for the best.

Now, SEO becomes the same thing. You don’t target the first page of results on Google for a particular term. You target an end user. You wrap your site messaging in terms that resonate with that user. You write in their language, you give them a reason to seek you out, and you sure as hell don’t disappoint them when they click through to your site. You do all this, and you remove all the technical barriers between your content and the indexes you need to be in. Then, you hope for the best.

The problem with SEO has always been that it’s been treated like some magical voodoo that can be applied after the fact, like some “secret sauce”. And yes, that was what the infamous Dave Pasternack has been trying to say. He just went several steps too far. The fact is, with universal search results, you could actually do this. Thousands of affiliates have made millions of dollars doing it. Link spamming, cloaking, doorway sites..the fact is, up to now, this bag of tricks has worked. It’s gotten harder, but it’s worked. Site owners looked to SEO to help them hi jack traffic that wasn’t rightfully theirs. They hadn’t done the heavy lifting to create a site that justified a place in the top rankings, and they tried to take an easy short cut.

But now, organic optimization means that you have to do the heavy lifting. It has to be integrated into the entire online presence. What Marshall Simmonds has done with About.com and the NY Times is a perfect example of the new definition of SEO. Get to the front lines, to the people who are churning out the content, and teach them about what search engines are looking for. Make sure SEO best practices are baked right into the overall process flow. Work with the IT team to create a platform that entices the spider to crawl deeper. Work with the marketing team to crawl inside the head of your target audience and figure out the who, the when and the why. Don’t worry so much about the where, because you can’t really control that any more. It’s a tough paradigm to break. We’ve been struggling with our clients for the past year or so. They’re still fixated on “being number one” for a particular term. We’ve been trying to ease them into the new reality, but it’s not easy.

I guarantee this will create an identity crisis for the SEO industry. As recently as a few months ago I was moderating a panel that was talking about analytics, and in the Q&A someone asked the panel, who had a few very well known SEM’s on it, about what they used for ranking reporting. The names of various options were thrown out and people started scribbling them down. I saw this and thought I had to comment.

“You know, the whole concept of ranking is quickly becoming irrelevant”

Nobody lifted their head, they were still busy writing down tool names. Maybe they hadn’t heard.

“As search engines move to personalized results, there will be no such thing as ranking. It will all be relative to the user.”

That should get their attention. Nope, nothing.

One of the search marketers said, “Yes, but knowing how they rank is still important to people.”

Huh? Am I speaking a different language here? I shook my head and gave up.

So, does this mean SEO is dead? Absolutely not. It becomes more vital than ever. Here are a few things that remain to be true. Preliminary results from the new SEMPO survey say SEO continues to be the number one tactic in search marketing. Yes, people want to bring it in house, but they recognize it’s importance.

Why do they think it’s important? Because it kicks ass in ROI. Here are the results from another recent study by Ad:Tech and MarketingSherpa, asking advertisers about the return they get from various marketing channels.

080569

The biggest jump from year to year? SEO. Now, let’s look at where marketers plan to spend more money in the next year.

080570

SEO, from flatlined last year to looking to spend 25% more this year. So SEO definitely isn’t dead. But it is moving to a new home. Here’s some early results from the SEMPO State of the Market Study (by the way, final results should be available next week. Look for them):

SEMPO2a

It’s true that most companies would far rather bring SEO in house, if they could. And when we consider the new definition of SEO, it probably makes sense for SEO to be integrated into the internal work flow. But the problem is that there’s not a lot of SEO expertise out there. If SEO was so easy, why don’t more companies do it, or do it well? Contrary to Pasternack’s argument, it’s not a “set and forget” type of tactic. It requires a champion, buy in and diligence.

I think the future is bright for SEO as a skill set, but we’re talking a modified set of skills. I talked about this in a recent SearchInsider column and a follow up online debate with Andrew Goodman. My view of the future for the really good SEO’s out there fall into three categories:

Get a (Really Good) Job

As companies bring this in house, there will be a firestorm of demand for skilled SEO Directors, but ideally as employees, not consultants.

Broaden Your View

Become an expert in how consumers navigate online and help your customers with the big picture, including the new reality of SEO.

Adapt and Survive

Find a new online niche where your search honed skills give you an advantage.

User’s View

Okay, this is already a much longer post than I intended, so I should probably talk about personalized search from the user’s perspective now.

Personalized search is a big win for the user. Don’t judge by the first few tentative steps Google is taking. Personalization is a much bigger deal than that. Google is easing us in so the experience isn’t too jarring. By the end of 2007, all 3 of the major engine’s results pages will look significantly different than they do today. Personalization will be like a breached dam. Right now we’re seeing the first few trickles, but there will be a wave of much deeper personalization options over the next several months. Search will become your personalized assistant, tailored to your tastes. As you search more, your results will draw more and more away from the universal default and closer and closer to your unique intent. Immediately after your query, you’ll be dropped into a much richer search experience. Disambiguation will become much more accurate, and you’ll find that you will pretty much always find just what you’re looking for right at the top of your page, without having to dig deeper. Here’s how I see it playing out at each of the big three:

Google

Google has a religious devotion to relevance, and as they gain confidence with personalized search and their ability to disambiguate, this will manifest itself with a laser focus on relevance above the fold. They will continue to maintain a good balance of organic results, but these results will not just be the current web search results. They could be local, image, news or a mix of each. And ads. Yes, you won’t escape ads, but Google will be the most judicious in what they show. Expect more stringent quality scoring, down to the landing page level and a high degree of relevancy in the ads that do show. Google will be the most concerned of the three in disambiguating intent.

Yahoo

Yahoo will put their own spin on personalization by wrapping in Social Search. They will continue to leverage their community, as they currently do in Yahoo! Answers so when you’re logged into Yahoo, you’ll be plugged into their community and that will impact the search results you see. Relevancy will be determined more by what the community finds interesting than what you find interesting, although it will be a mix between the two. Yahoo will target two types of searches, serendipitous search, where you’re looking to discover new sites, and what I call “frustrated” search, where your own efforts to unearth the data online have come up empty and you want the help of the community. When it comes to monetization, Yahoo will be the most aggressive, pushing more ads above the fold into Golden Triangle real estate. These ads will trail Google’s in terms of relevance

Microsoft

Microsoft will use their targeting capabilities and probably tie in some behavioral targeting to personalize their search results. Also expect personalization in the Microsoft product to be integrated at a deeper, more ubiquitous level, into apps and OS. This probably won’t happen in 07, but it will be a long term goal. When it comes to ad presentation, Microsoft will fall somewhere between Google and Yahoo in both the number and relevance of the ads being presented. The heaviest investment will be in building out the platform to manage and model the ad program, rather than in policing the quality of the ads themselves.

It promises to be a very interesting year in the Search Marketing biz!

The Social Fabric of Search

First published February 1, 2007 in Mediapost’s Search Insider

You know the phenomena of Synchronicity, where once you become aware of something it seems like everyone is talking about the same thing? You can’t turn a corner without seeing some reference to something that just a week ago didn’t even register on your social consciousness. For me that was social search and the time was last week. While I was certainly aware of social search before that, for some reason, last week was the week where the knocking got so loud I had to pay more attention.

In looking at the referrer logs for my blog I noticed that Stumbleupon seemed to have emerged as a major traffic source. Also last week, I was on a panel with Danny Sullivan and he mentioned that we have to start watching social engines like Digg and Stumbleupon as emerging trends in the search space. Finally I did an interview with Larry Cornett, one of the key usability people at Yahoo, and when I asked him what the differentiating factor was for Yahoo in the future, he pointed to the emergence of social search and gave me Yahoo! Answers as the current example of that in practice.

There seems to be a lot of buzz around social search but exactly how is social search shaping our search experience and why we should be looking at it in the future? When Danny Sullivan mentioned that social search is something to keep your eye on, I made the point that different types of search engines lead themselves to different types of search activity.

Serendipitous Search

What I noticed Stumbleupon show up in my referrer report, I did some investigation into what Stumbleupon is about. Stumbleupon is the embodiment of serendipitous search. Its whole purpose is to help you find new sites that you might think are interesting. And here’s where the aspect of social search, or community, comes in. Stumbleupon depends on a network of like-minded people to earmark sites that would be of interest based on your profile. It’s based on the concept that great minds think alike. Apparently, someone in the online universe had pegged my blog as one that might be of interest in some particular niche and suddenly dozens of other people were stumbling upon it, guided by their online friends.

Stumbleupon is probably the best example of serendipitous search but Digg is another one, albeit with a slightly different flavor. While Stumbleupon helps you find sites, Digg connects you directly to new content about specific topics. Like Stumbleupon, Digg uses a rating system to allow community members to vote on whether a site or story is noteworthy. Both Stumbleupon and Digg have emerged as significant drivers of traffic in recent months so as marketers, we have to keep these sites on our radar.

From the user’s perspective, the aspect of social search becomes interesting in these two examples because they help guide us to explore undiscovered territory online. We’re going where we haven’t been before and it helps us when people who share our interests can guide the way. In each case, social search lends credibility to new sites with which we have no previous experience.

The Wisdom of Crowds

James Surowiecki wrote a book called the Wisdom of Crowds. The basic premise of the book is that crowds, given the right conditions, can be amazingly intelligent. He cites a number of examples where a large group of people, acting independently with limited amounts of information, collectively came to decisions that were more valid than those of all but the very smartest individuals within the group. The whole became greater than the sum of its parts.

This is the basis of a new flavor of social search where the community collectively builds the index of the search engine. Consider Yahoo! Answers. You pose the question and Yahoo’s community kicks into gear to provide the answers. These answers are aggregated and provide searchable content that make up Yahoo! Answers. Based on my conversation with Larry Cornett and recent comments by Yahoo CEO Terry Semel, it appears that Yahoo Answers provides a clue into their strategy for going head to head with Microsoft and Google. This concept of community building a better search experience is key to Yahoo and a main strategic platform for the future.

Another example of this variation of social search can be found in Search Wikia, the new search initiative that “is going to change everything” according to Wikipedia founder Jimmy Wales. In Search Wikia, it’s a case where the broad concept seems to be in place but the specifics on how it’s going to be executed still seem a little thin.

The biggest challenge with this variation of social search is that it depends on the engagement of individual members of the community. Unless you have volunteers that are willing to spend their time enhancing the search experience, the scalability of the project breaks down. Anything that depends on people to take time to tag results, to contribute or to answer questions is dependent on the person’s motivation to participate. While that’s present in a very small percentage of our population, it’s not a commonly found trait in most of us. It’s generally been proven that hardware is rapidly scalable, people are not.

However you define social search, the fact remains that the combination of search and the very notion of an online community are inherently aligned. Communities are all about connections, and nothing can connect faster than online search. It will take us a while to smooth out the wrinkles, but search is fundamentally social and communities are fundamentally connected. These concepts will live together in the online world.

 A new study from BIGResearch has shown that Word of Mouth continues to be the most influential factor in consumer decisions.

080193

There’s nothing too earth shaking about this. But consider how Word of Mouth is defined today.

The Web has taken Word of Mouth, which used to be restricted by geographic realities, and exploded it outwards in all directions. Even the very phrase implies a face to face conversation, which by necessity restricts how quickly word of mouth could spread. But now, word of mouth encompasses consumer generated media, which means that stated opinions can spread much further and faster than ever before.

Perhaps the easiest way to judge the implications of the web effect on word of mouth is to strip it back to it’s essential meaning, and then work outwards again.

Word of mouth implies that you’re getting an opinion from someone who:

    1. is familiar with a product or service through personal experience; and,
    2. can be objective because they have no vested interested in whether you buy the item or service in question.

If it meets these two criteria, word of mouth has the ring of authenticity, which is rapidly becoming a valuable commodity on the Web. Historically, word of mouth came primarily from friends and family, so our circle of potential influencers was limited to a few hundred people at the most. We received our word of mouth recommendations in two ways. Either the person giving the opinion had become an evangelist for the product and was offering their opinion whether it was asked for or not, or we would seek out someone we knew who we trusted and who we knew to have previous experience with a product or service. For me, the second type of word of mouth was generally a little more influential. In either case, the reach was restricted, because there was no way for the average person to expand their communication network beyond their normal contacts.

If you took an evangelist and tried to expand their coverage, the value of the message eroded. If the vendor facilitated this, the authenticity decreased and the message became a testimonial. Influential, yes, but not truly word of mouth. Or if the person happened to have a forum that allowed them the spread the word farther, i.e. a newspaper columnist or a TV personality, the authenticity was lost and it became another celebrity endorsement. Again, influential, but missing the grass roots power of true word of mouth.

For word of mouth to be truly powerful, it has to live close to the ground, come from real people, and not have the faintest whiff of commercialism about it.

Now, look at what the empowerment and connectivity of the Web has enabled. If a person chooses to be an evangelist, they still sacrifice authenticity, even if distribution of the message is done digitally. But search allows consumers to connect to real people, just like you and I, who have shared their opinion on something with us online. This maintains authenticity, and opens up the new power of word of mouth.

Think of what sites like TripAdvisor has done for travel. If you were going to go to Florence and you wanted to find a hotel, what would be the odds 15 years ago of finding someone in your social circle that would have the personal experience necessary to give you the advice you were looking for? Probably slim. But now, through search, you can find a number of people who have all stayed at hotels in Florence and have shared their experiences, both good and bad. TripAdvisor uses this collective “word of mouth” to rate the hotels. It’s tremendously influential and it’s available to all of us.

This tying together of consumers into ad hoc ideological communities around a product or service is becoming tremendously powerful, and is completely redefining the principles of marketing and branding.

Top Spot or Not in Google?

Brandt Dainow at Think Metrics shared the results of his campaign performance with Google Adwords and came up with the following conclusions:

    • There is no relationship between the position of an advertisement in the Google Ad listings and the chance of that ad being clicked on.
    • Bidding more per visitor in order to get a higher position will not get you more visitors.
    • The number one position in the listings is not the best position.
    • No ad position is any better than any other.
    • The factor which has the most bearing on your chance of being clicked on is the text in your ad, not the ad’s position.

These conclusions were arrived at after analyzing the Google ads he ran this year. He says,

“while position in the listings used to be important, it is not anymore. People are more discriminating in their use of Google Ads than they used to be; they have learned to read the ads rather than just click the first one they see”

This runs directly counter to all the research we’ve done, and also that done by others, including Atlas one point. So I decided it was worth a deeper dive.
First, some facts about the analysis. It was done on ads he ran in October and November of last year, for the Christmas season. He acknowledges that this isn’t a definitive analysis, but the results are surprising enough that he encourages everyone to test their own campaigns.
In the following chart, he tracks the click through per position.

Dainow
Brandt expected to see a chart that started high on the left, and tapered down as it moved to the right. But there seemed to be little correlation between position and click through. This runs counter to our eye tracking, which showed a strong correlation, primarily on first page visits. Top sponsored ads on Google received 2 to 3 times the click throughs.

enquirorank

Further, Atlas OnePoint did some analysis from their data set, and similarly found a fairly high correlation between position and click through on Google and Overture/Yahoo.

atlasrank

So why the difference?

Well, here are a couple thoughts right off the bat. Dainow’s data is exclusively for his campaigns. We don’t see click through rates for the other listings, both paid and non-paid, on the page, so we can’t see how his ads stack up against others on the page. Also, it may be that for the campaigns in question, Brandt’s creative is more relevant than the other ads that show. He makes the point that creative is more important than position. I don’t necessarily agree completely. The two work together. The odds of being seen are substantially higher in the top spots, and your creative doesn’t work if it isn’t seen. The discriminating searcher that Dainow sees emerging who takes the time to read all the ads isn’t the searcher we see in eye tracking tests. That searcher quickly scans 3 to 4 listings, usually top sponsored and the top 1 or 2 organic listings and then makes their choice. This is not only true of our study, but the recent Microsoft one that just came out. Although Dainow’s charts over time certainly seem to show that position is less important, there could be a number of other factors contributing to this.

I will agree with Brandt though that if seen, relevant and compelling copy does make a huge difference in the click through rate of the ad. And for consumer researchers in particular, I still see search advertiser’s cranking out copy that’s not aligned to intent. But all the evidence I’ve seen points to much higher visibility, and hence, click throughs, in the top sponsored spots.

When looking at analysis like Brandt Dainow is presenting, you have to be aware of all the variables. In this case, I’d really like to know the following:

  • What were the keywords that made up the campaigns
  • What was the creative that was running for his clients
  • What was the creative the competition was running
  • What were the overall click throughs for the page

In doing the analysis, you really need to control for these variables before you can make valid conclusions. Some are ones we can know, others, like the overall click throughs, only the engines would know.

But Dainow is quick to point that his findings show the need for individual testing on a campaign by campaign basis. And in that, we’re in complete agreement. Our eye tracking tests and other research shows general patterns over common searches, and the patterns have been surprisingly consistent from study to study. It probably gives us as good idea as any what typical searcher behavior might be. But as I’ve said before, there is no such thing as typical behavior. Look at enough searches and an average, aggregate pattern emerges, but each search is different. It depends on searcher intent, it depends on the results and what shows on the page, it depends on the engines,  it depends on what searchers find on the other side of the click. All these things can dramatically affect a scan pattern. So while you might look to our studies or others as a starting point, we continually encourage you to use our findings to set up your own testing frameworks. Don’t take anything for granted. But that’s a message that often doesn’t get through. And my concern is that advertisers looking for a magic bullet will read Dainow’s conclusions highlighted at the top of this post and swallow them whole, without bothering to digest them. And there’s still far too many question marks about this analysis for anyone to do that. I’ve contacted Dainow to set up a chat so I can find out more. Hopefully we can shed more light on this question.

Social Networking Research Update from KnowledgeStorm

A few posts ago I talked about KnowledgeStorm’s new study on the use of social networking by B2B technology buyers. Apparently, the two facts that were getting reported were a little misleading in the way they were presented. Matt Lohman from KnowledgeStorm clears them up:

“I wanted to thank you for referencing the recent research study from KnowledgeStorm. I thought I would clarify some of the confusion with the respondent percentages: The write up of results that you reference is a bit misleading. I’ll try to explain without getting too off the deep end…

We asked about familiarity with social networks first, for which 35% replied “not familiar at all” while another 42% replied “somewhat familiar” adding up to the 77% figure. As part of further validation, the next question asked “How often do you visit social networking sites?” from which we received 31% stating “Never”. This is very close to the 35% who were “not at all familiar” in the previous question. Good confirmation there. From that point forward in the questioning, we excluded anyone who claimed they “never” visit social networking sites (the 31%). Therefore, when we got to the question that asked “What are your primary reasons for using social networking sites?” the only respondents were those individuals who visit social networking sites at least once a month (69%). Of the individuals using these sites, 70% are doing so for business development networking or development reasons.

I still think your conclusions are valid but also wanted to make sure our research wasn’t getting misconstrued. “

Thanks Matt

This is Not Your Kid’s Social Network: Leveraging LinkedIn

The worlds of social networking and search are beginning to blur more and more. And the number of influencers that are networking is higher than you might think. It’s not all about MySpace, but in many cases, contact networks like LinkedIn. New research from KnowledgeStorm and Universal McCann shows these seemingly contradictory findings:

“Seventy seven percent of B2B technology buyers have little to no familiarity with social networking online. Of the 24% who are very accustomed to social networks, a large majority of the respondents visit these sites at least once a month.

70% of B2B technology buyers use social networking sites for business networking and/or development, though 59% admit to also using these sites for personal reasons.”

So if 77% don’t know what social networking is, but 70% use them, what’s going on? I think it comes from many people not knowing that having a LinkedIn or Plaxo network actually counts as social networking. They’re participating, but they don’t know it. When they think social networking, they’re thinking about teenagers spending hours on MySpace or Second Life.

And at 70% usage, it’s a channel worth paying some attention to. Luckily, Guy Kawasaki recently engaged Kay Luo and Mike Lin at LinkedIn to brush up his profile. Check out the results of Guy’s Profile “Extreme Makeover”.

ChaCha and the Search Tango

There’s a new crop of search interfaces coming out, many spin offs from the big engines themselves, and I’ll be trying to take a look at them from the user’s perspective. Today I took ChaCha for a spin. Here’s some background (and hype) from their About page

“ChaCha stands out as different and better in a landscape cluttered with common search engines because it uses the World’s most powerful technology – The human brain.

ChaCha’s goal is to provide a better search experience by combining results that are hand-picked by our knowledgeable human guides with the best computer-generated search results. In those cases where you can’t find what you need with our instant results, ChaCha will connect you with a live human guide who will find the information for you through an instant messaging-style search session.

Scott Jones and Brad Bostic, two dynamic entrepreneurs who were not satisfied with millions of irrelevant search results provided by first generation search engines, believed a better experience could be created by tapping into human intelligence. Since starting ChaCha, they have been hard at work with the ChaCha team to create:

  • A smart search engine that “learns” by tapping into human intelligence so its results are always improving
  • A place to find exactly what you’re looking for instantly
  • Help from people who are knowledgeable about the very thing you are looking for when instant results don’t have the answer “

Fellow Enquiro blogger Marina Garrison tried out Cha Cha and shared her thoughts. Here are mine. Unfortunately, there’s no good news here for the Cha Cha team.

“A Better Search Experience”

I started out by looking for hotels in Kauai. I used the default, automated search. At the same time, I did a search on Google for the same query. My intent was to compare my options, so I was looking for a link that would show me a number of properties. Google did pretty well, with both official and unofficial accommodation guides rounding out the top algorithmic results returned in the customary fraction of a second. Definitely something here I would click on.

Cha Cha’s automated results were far less satisfying.

  chachaorigsm

First, there was a sponsored link at the top, but no advertiser. That’s okay, it’s a beta, so I didn’t really expect one. But all the other results have a “sponsored by” line at the bottom. I’m confused. Are they sponsored links or not? Confusion is not good in a user experience. The results were mostly for individual properties, not very descriptive, and the same site showed twice in the top 4 results. The only guide I saw was well down on the top 10, and it wasn’t an official guide. The results weren’t really matched to my intent. Strike Two.  Once again, what was it that Cha Cha was offering?

ChaCha’s goal is to provide a better search experience by combining results that are hand-picked by our knowledgeable human guides with the best computer-generated search results.”

Oh..right. Okay, maybe I’ll try the “knowledgeable human guide” because after all, “it uses the World’s most powerful technology – The human brain”

I hit the search with guide button

The interface changed and opened up a pane on the left. There was a pause of at least 10 seconds while I waited to connect with a guide. In 10 seconds on Google, I’d have clicked off the page by now, but I’ll be patient. Finally I’m connected to DelaineL, who greeted me with a “Good Afternoon”. This despite I did this at 10 am local time. Hmmm..mental note for Scott and Brad, our “dynamic entrepreneuers”…you’ll have to work out that time change thing.

Now, I wasn’t sure what to do. Do they just pick up from the last query I did? There were no instructions I could see. I waited. Finally DelaineL sent me a “Hi!”. I guess I have to reenter my query in the message box. We’re approaching a minute now. I told Delaine (not sure whether this is a male or female Delaine) I was looking to compare hotels in Kauai. I wanted to be fair, giving my human guide a chance to give me the types of results I was looking for.

“Find exactly what you’re looking for instantly “

I was expecting a page of 10 results to pop right up. Instead, after many more seconds, I got one.

chacha1sm

And it was for the same site that showed up twice in the top 4 organic results. This was the best that the “world’s most powerful technology” can do?  Also, the page they sent me was actually a landing page built for a Google Adwords campaign. Not really what I was looking for. So, was this the only result I was going to get? I asked my guide. I was told the second result was loading. When it came up, it was an Expedia search results page, along with an apology for the delay and the assurance that Delaine was looking for the most relevant results. The response sounded suspiciously canned though.

chacha2sm

I guess that’s what took the time, the guide went to Expedia and launched the search for me. I guess that’s good.

“People who are knowledgeable about the very thing you are looking for “

Okay, I’m sure Delaine is an excellent person, kind to kids and animals, and is probably an expert in many areas, but what makes him/her an expert on Kauai? How does Delaine know what I was searching for? Does ChaCha have a room full of people monitoring my initial search activity, and when I click on the guide button, a red light starts flashing and an announcement rings out at Cha Cha Headquarters, “Attention, we need a Kauai Expert on seach 1045..Stat!!” ? I somehow doubt it. Lets put the “knowledgeable” line down to more marketing spin.

Also, do we really want a human somewhere knowing what we’re searching for? I don’t think so. Most of us prefer to search anonymously, or at least what we think is anonymously (ignorance is bliss in this case, until we’re rudely awoken by a AOL debacle). I suppose if someone were really stuck, they would try their luck with a search guide, but based on my experience, it wouldn’t be something I would ever do again.

By this point, I had spent a good 2 or 3 minutes doing something that would take a few seconds on Google, and I didn’t get results any better than I would have received there. Sorry ChaCha, but you hit a sour note with me.

And now I go on my user experience diatribe. There’s obviously a lot of infrastructure behind Cha Cha. I have no idea how many human guides they have but to make this scalable (they say thousands), but it appears that they’re paid by the search. This is not a cheap start up. But this will undoubtedly fail. It offers no compelling reason to use it. It’s far inferior to other options that have established themselves with users. A little bit of research should have shown this. I’ve talked to a few people who have used it. None of them will ever use it again. I’m sure the people at ChaCha will say they had tremendous response from their initial tests. BS. If thats the response they got, they weren’t doing the tests correctly. This will be a waste of a lot of people’s time and some significant investment on somebody’s (apparently Jeff Bezos) part. And it could have been avoided with proper usability testing. There’s a lot wrong with ChaCha, and not much right. The interface is junky and clunky. It’s like a flashback to the dot com bubble.

If you’re going to Cha Cha, try not to step on your partner’s toes. I’m still limping.

Postscript

After the post, I ran across Rob Garner’s SearchInsider column from yesterday (obviously have to clean out my folders more often) on his experience with ChaCha. While not ideal, it seems Rob is more optimistic than I am:

“I would bet that they find a niche in the market with a loyal user base, and that we may see more innovation from them to come in the form of user interface, and/or behavioral research. “

I guess one thing ChaCha has going for it is the ability to get live user feedback, real time. I hope they listen.

Why No “Golden Triangle” in the Microsoft Eye Tracking Study

Over at Searchengineland, Danny Sullivan did a deeper dive into the Microsoft Eye Tracking Study that I posted about last Friday. In it, Danny said:

“Interesting, the pattern is different that the “golden triangle” that Enquiro has long talked about in its eye tracking studies, where you see all the red along the horizontal line of the top listing (indicating a lot of reading there), then less on the second listing, then less still as you move down. “

I just want to draw a few distinctions between the studies. In our study, we wanted to replicate typical search behavior as much as possible, so let people interact with actual results pages. In the Microsoft study, they were testing what would happen when the most relevant result was moved down the page and how searchers responded to different snippet lengths. The results, while actual results, were intercepted and were restructured in a way (i.e., stripping out sponsored ads) to let the researchers test different variables. We have said repeatedly that the Golden Triangle is not a constant, as is shown in our second study, but follows intent and the presentation of the search results.

In fact, the Microsoft study does confirm many of our findings, in the linear scanning of results, the scanning of groups of results and the importance of being in the top 5.

Another potential misconception that could be drawn from Danny’s interpretation of results is hard and fast rules about how many results searchers scan. He settled on the number five. When looking at eye tracking results, it’s vital to remember that there is no typical activity. Please don’t take an average and apply it as a rule of thumb. Averages, or aggregate heat maps, are just that. They’re what happens when you take a lot of different sessions, varying greatly, and mash them together. Scanning activity is highly dependent on the intent of the user and what appears on the search results page. A particularly relevant result in top sponsored, matched to the intent of the majority of users, would probably mean little scanning beyond the first or second organic result. On the other hand, if the query is more ambiguous, you could see scanning a lot deeper on the page. The Microsoft study used two tasks that would generate a limited number of queries, and recorded interactions based on this limited scope. Our studies, while using more tasks, still out of necessity represented the tiniest slice of possible interactions.

After looking at over a thousand sessions in the past 2 years, I’ve learned first hand that there are a lot of variables in scanning patterns and interactions with the search page. An eye tracking study provides clues, but no real answers. You have to take the results and try to extrapolate them beyond the scope of the study. We spent a lot of time doing this when writing up both our reports. You try to find universal behaviors and commonalities, but you have to be very careful not to accept the results at face value. Drawing conclusions such as snippet lengths should be longer or that official site tags should become standard are dangerous, because it’s not true for every search. The study actually found that ideal snippet length is highly dependent on the task and intent of the user.

If anything, what eye tracking has shown me is the need for more flexible search results, personalized to me and my intent at the time.