How to track Universal Search traffic with Google Analytics

Thu 17 December 2009 16:30, Martijn Beijk

How to track Universal Search traffic with Google Analytics

Martijn Beijk opened his Searchcowboys-account with a blast. His post "How to track Universal Search traffic with Google Analytics" was the first ever Searchcowboys post to go "hot" on Sphinn. He actually taught a lot of people some great Analytics insights.

How to track Universal Search traffic with Google Analytics
Originally posted on January 16th 2009

After reading the post by Heini van Bergen on setting up filters on Google Analytics something caught my attention. Something I was looking for, since I started researching Local Search Optimisation.  I wanted to know how many people were actually clicking the blended results you see in Universal Search. Google Analytics measures these clicks as Google (organic). But what if my link appears in the SERPS twice? How do I know which link was clicked? And if my link is listed in the SERPS more than once, which one of them is converting in a better way?

Universal_search_analytics
Image: Universal Search illustrated.

Looking into the SERP source code can give you a lot of insight. Google is showing parameters for
Universal Search results. This will give us the possibility to set up some filters or advanced segments, based on the full referrer URL.

Overview of parameters:

  • sa=x   eXtended listings (regular tracking links show sa=t , traditional )
  • oi=  this parameter specifies the specific universal search feature.
  • cd=  internal position of a link within the specific universal search item specified with `oi`.

Unfortunately not all links from Universal Search boxes can be monitored in this way directly, for example those listed from Local Search results. 
These will show a direct link to the landing page designated for the local business owner. This landing page can be defined in the Local Business Center (and you should!).
So what can we measure directly and how do I set up filters or create advanced segments for them?

Measured directly

The following are specified by the parameter oi

  • Blog Search: blogsearch_group,  blog_result 
  • Image Search: Image_result ,  image_result_group
  • Spelling corrections: spell                                                
  • Sitelinks: smap                                             
  • Definitions: glossary_definition                              
  • Suggestions (link to suggestions/revisions): revisions_inline, revisions_narrow

Measured indirectly
this means that a user clicked on a universal search link, but went to the Google landing page first before going directly to your website, parameters are passed on by Google. Note that if this occurs, it can mean that it took one click to many for the user to get to your website because they couldn’t find what they were looking for in the first place.

Setting up the filters

Step 1 :
Create filter for organic traffic
New filter ->
Filter name `Organic`
Filter Type -> Custom Filter
Checked : include
Filter Field: Campaign Medium
Filter Pattern `organic`

Step 2:
Create filter for All Universal Search traffic
New Filter: ‘Universal Search Items
Filter Type: Custom Filter
Checked: Advanced
Field A -> Extract A -> Referral -> (.*)oi=([a-zA-Z_]+)&(.*)
Field B -> Extract B -> Referral -> (\?|&)q=([^&]*)
Output To -> Constructor -> User Defined -> $B2 : $A2

You can also create separate filters for some of the Universal Search items instead of all of them.

Custom Step:
Create filter for Universal Search - specific
New Filter: ‘Universal Search | images’
Filter Type: Custom Filter
Checked: Advanced
Field A -> Extract A -> Referral -> (.*)oi=image(.*)
Field B -> Extract B -> Referral -> (\?|&)q=([^&]*)
Output To -> Constructor -> User Defined -> $B2 : $A2

You can repeat the custom step above with all the variables for ‘oi’ available. 
The output (after step 2) should look like this:

 

User%20Defined%20-%20Google%20Analytics_12319287102591

Also, you might consider filtering out the &gl and &hl parameter so you know which engine the search originated from.

What can we do with all this information?

Nice to have all these filters setup and to gain some more insights in clicks from the organic search results, but what use has it?
If the search results for a specific key phrase show both images and ‘regular’ text links for a specific key phrase, how can I tell if the image or blog link was clicked instead of the regular one? They both seem to originate from the same source (Google), same medium (Organic) and for the same keyword. Setting up these filters will help you distinguish the traffic.
Do images get less clicks? Or more? Or are users more likely to click the blog result than the regular search result? And is someone who clicked on an image more likely to convert into a lead or action? Or is it the opposite?

Set up these filters and you will know! Feel free to share your experiences.

RELATED POSTS:

Google giving away exact ranking position?
New design for Google Universal Search?
Eyetracking shows Universal does change behavior
German Landtag will no longer use Google Analytics
Google killed the analytics cat?


  • Comments (27)
  • SEO
  • Tell-a-cowboy

Comments (27)

 

  • Great! you did it :)

    Vr 16 jan 2009, 16:24


  • Very cool. Honest!

    Vr 16 jan 2009, 16:32


  • Great post, Martijn!

    Vr 16 jan 2009, 16:34


    • Arian Kuschki

    Hi Martijn,
    interesting post. Did you check if the 'oi' parameter actually survives the redirect round-trip? When I try this on my Firefox the document.referrer seems to get cut off, in any case it doesn't show the parameter. Which would mean the GA tracking code can't see it either.

    Vr 16 jan 2009, 16:36


  • Oh man, that is awesome. I've been screwing around with their SERP source code to change the styling of the search listings, but I completely overlooked the parameter values. Thanks for sharing - I'm adding these filters to some clients today.

    Vr 16 jan 2009, 16:38


  • @Arian
    Hi, thx for commenting and yes I did check, the screenshot shows an example for a tattoo related website.
    The oi isn't available in all cases (news, local, youtube). Although you sometimes see local oi appearing.
    I would recommend just to set up a testing profile, capture all organic - full referrer traffic and build an advanced segment. Once you get the hang of it copy your profile and install the filters, customize to your needs.

    Vr 16 jan 2009, 16:45


  • Way to go Martijn!

    Vr 16 jan 2009, 16:47


    • Arian Kuschki

    after some quick testing it looks like the URL parameters that are part of the 302 are not visible in the document.referrer, while parameters like "revisions_inline" are visible because they are part of the original SERP URL.

    what do you think?

    Vr 16 jan 2009, 16:54


    • Arian Kuschki

    MArtijn, just saw your reply, thank you. But I can see the "oi" in the URL of the intermediate Google redirect page when I look at sitewide links, for example. But when the browser loads the landing page, it doesn't state the intermediary page as the referrer, but rather the original SERP URL. which means GA can't see the parameter either. Does that make sense?

    Vr 16 jan 2009, 16:57


  • I think the fact that this post went front page on sphinn in under 40 minutes of submission is a testament to its usability. Excellent work.

    Vr 16 jan 2009, 17:57


  • Great! Wil read more in detail this weekend but already looking forward to reading it now!

    Vr 16 jan 2009, 18:38


  • Nice Effort!
    Martijn!

    Vr 16 jan 2009, 19:59


    • Atul

    Very Good post. I have a query where can I see the results of Universal search items. Is it in User Defined or somewhere else. Please specify

    Za 17 jan 2009, 04:51


  • Interesting post. I'm using Google Analytics and it has been very helpful .. I'm going to try some of the suggestions ...

    Za 17 jan 2009, 10:35


  • Very nice article.

    @rishil: well said

    Zo 18 jan 2009, 07:17


  • Haven't had the time till now, but definitely worth the read, Martijn. Hope we can see more of this in the near future :)

    Zo 18 jan 2009, 13:33


    • Joris Toonders | Yonego
    • [website]

    Great post. Thank you, Martijn!

    Zo 18 jan 2009, 23:07


  • thx for all the comments!

    another tip:
    to capture a bit more than just the search query you can use the following as extract B:
    google.(.*)/.*hl=([a-zA-Z-]+)&?.*q=([a-zA-Z0-9+]+)

    and make sure to change the output, and adjust to your likings.
    For example:
    engine:.$B1 hl:$B2 query:$B3 oi:$A2


    Vr 30 jan 2009, 22:38


  • Nice post, but I think it's fundamentally flawed. Sure, you can track search traffic from other google properties (like google images, google local etc) using filters. This is very useful and advisable.

    BUT, it still doesn't let you track traffic from blended serps as far as I can see. The referrer is the same whether you're clicking on a local one-box or a regular listing in the serps.

    Am I missing something? Please let me know as this would be amazingly useful to have but I don't see how it's possible.

    Tom

    Wo 18 feb 2009, 14:59


  • @Tom
    the local box is a difficult example but also there you will see that a different referrer URL will be transfered containing the specific parameter value for that item.

    Wo 18 feb 2009, 15:06


  • Hi Martjin,

    In principle yes, but when you get redirected through a Google URL that contains the oi parameter this is a 302 redirect and the referrer will NOT contaion the oi parameter.

    Have you actually used this in practice? I'm happy to be proved wrong but as far as I can see it won't work.

    Wo 18 feb 2009, 15:12


  • @Tom

    I'm just telling what I see right here in my analytics package. It contains lots of oi parameters, also for local results, blog results, spelling corrections, revisions, blended(mobile), etc.

    I will have to match these to server logs, something I haven't done so far. But how to explain that these parameters are passed to analytics if they are not in the referrer?

    Wo 18 feb 2009, 15:33


    • Xavier Lee

    I was just wondering if anyone here is looking for more traffic? I work with eZanga.com and we have tons of traffic Search,CPV, and Display) Search Arbitrage works great!

    Ma 13 apr 2009, 23:56


  • Great post. I’ve been looking for a way to do this for a while. I’m surprised Google Analytics doesn’t have something built in to accomplish this since it’s inaccurate to say that something that was the result of google product search is organic which is the way it shows up in GA.

    My question is, is this retroactive? I just added this filter and I don’t see any results even though I know the client has been using Google Product Search.

    Ma 24 aug 2009, 08:25


    • Susie

    How do we separate Google Shopping results on Google Analytics? Would be interested to see a post on this

    Thanks

    Do 3 dec 2009, 11:57


  • Hi Susie,

    It should be possible to tag all your URL's in your XML feed you supply to Google Base.

    Zo 6 dec 2009, 22:37


  • Thanks for the heads up on Tagging the Base Feeds. I was wondering if that was possible.

    Wo 9 dec 2009, 15:02

Comment

  • HTML is not allowed. URLs are automatically clickable.
    * Email address is not shown



  • 50 SEO's 1 question
  • Google Friendconnect introduction
  • SEO Oktoberfest 2008
  • SEO Wars - Planet Link Space
  • Online Workshop: Managing SEO Projects 10 Mistakes, 10 Keys

Related tweets


Last Comments


Specials

  • My two weeks notice: I'm leaving Searchcowboys Columns

    Bas his two weeks notice: I'm leaving Searchcowboys

  • Guestpost Richard Zwicky: differences in user behavior Guestposts

    Guestpost Richard Zwicky: differences in user behavior

  • Guestpost Dennis Goedegebuure: Content behind the pay wall Guestposts

    Guestpost Dennis Goedegebuure: Content behind the pay wall

  • Getting attention through creative adtexting SEA

    Winner best post of 2009: Getting attention through creative adtexting


Events

Last event
Upcoming event

Bloggers

  • Bas van den Beld
    Bas van den Beld

    Profession: Chief Editor Searchco...

    Company: NetTraject / Searchco...

  • Evert Veldhuijzen
    Evert Veldhuijzen

    Profession: Managing Director Ger...

    Company: Veroworx KG / Onetoma...

  • Jon Myers
    Jon Myers

    Profession: Head of Search / Asso...

    Company: MediaVest

  • Sam Murray
    Sam Murray

    Profession: Senior Search Consultant

    Company: Verve Search



SEO Roadshow
Lisa D Myers
SEO Roadshow: interview wit...

More than a month ago the SEO-Chicks weblog started a contest to find new recruits for their b...


Columns




Agenda

» Mobile World Congress

Barcelona

15 February 2010 / 18 February 2010

» Search Engine Strategies London 2010  SC will be here

London

16 February 2010 / 19 February 2010

» SXSW

Austin, Texas

12 March 2010 / 21 March 2010

» Enterprise Social Media

Olympia London

15 March 2010

» Social Media World Forum

Olympia London

15 March 2010 / 16 March 2010

» Social TV Forum

Olympia London

16 March 2010

» Cloud Computing Congress

Olympia London

16 March 2010


Newsletter

Subscribe to SC Newsletter:


RSS Feed

Follow us on TwitterWinner best post of 2009Lipperhey Free SEO analysisSearchcowboys on Webmasterradio How are the searchengines doing?Biglist SEO

Button_sc_ad


Search


Twitter

» SC Tweetfeed

» Follow SC Tweetfeed



My BlogLog


Flickr

  • DSP-history-of-my-blogDSP-Google-before-you-tweet
  • DSP-Map_UK_internet_visitsDSP-Google-binged
  • DSP-Japanese_maps_weirdnessDSP-Google-Why...
  • DSP-David_Cameron-SEODSP-googolopoly
  • SERP-polution-DennisDSP-Matt-Cutts-Daily-life
» SC on Flickr

Podcasts

    • The SEO-Chicks set up a contest to find new bloggers. Bas van den Beld and Lisa Myers talk to the winners Sarah Goodwin and Nichola Stot.
    • Jon Myers and Bas van den Beld talk to Joanna Butler about A4U Expo London in October 2009
    • Jon Myers and Bas van den Beld talk to Mel Kirk about A4U Expo London in October 2009
    • Jon Myers and Bas van den Beld talk to Gillian Muessig about A4U Expo London in October 2009
    • Jon Myers and Bas van den Beld talk to Lyndon Antcliff about A4U Expo London in October 2009
    • Bas van den Beld talks to Dixon Jones about his session at A4UExpo London 2009
    • Bas van den Beld talks to Christoph Cemper about his session at A4UExpo London 2009
    • Jon Myers and Bas van den Beld talk to Lisa Myers about A4U Expo London in October 2009
    • Jon Myers and Bas van den Beld talk to Will Critchlow about A4UExpo London in October 2009
    • Bas van den Beld talks to Roy Huiskes and Eduard Blacqueire about what happened in search in the past month.
    • In a special Calling UK Dave Naylor and Bas van den Beld discuss the 'case of the Guardian'.
    • Bas van den Beld talks to the German runners up of the Google Online Marketing Challenge
    • Bas van den Beld called with Roy Huiskes and Eduard Blacqueire about what went on in Search in Holland in July
    • Bas van den Beld talkes to Roy Huiskes and Eduard Blacqueire about Search in Holland
    • Bas van den Beld called Dave Naylor to find out what went on in Search in the UK in the last couple of weeks.
    • Bas van den Beld and Roy Huiskes discus what happened in search in Holland in May 2009.
    • Heading up to SMX London next week Searchcowboys' Bas van den Beld got to talk to the keynote speaker, Brian Fetherstonhaugh.
    • Podcast in which Bas van den Beld, Roy Huiskes an Eduard Blacquière discuss what happened in search in Holland in March and April 2009.
    • Bas van den Beld interviewed Andrew Girdwood for the SEO Roadshow.
    • Bas van den Beld called Dave Naylor to find out what Dave thought about what went on in the UK market in February 2009
    • Podcast in which Bas van den Beld, Eduard Blacquière and Roy Huiskes discuss what happened in search in Holland in January 2009.
    • Joost talked to Avinash Kaushik
    • Joost de Valk kicks off the SEO Roadshow by talking to Kevin Ryan, global content director Search Engine Strategies.
  • Rss_small  Subscribe via RSS




© 2010 Searchcowboys.com - All Rights Reserved - All views and opinions expressed are those of the authors of Searchcowboys.

All trademarks, slogans, text or logo representation used or referred to in this website are the property of their respective owners. Sitemap