Search Term Tools – Measuring Popularity

One of the first and most obvious types of data we want a search term is just how popular it is with searchers. This is important for all search engine marketers, whether they are working on SEO or PPC campaigns.

Unfortunately, when it comes to keyword popularity, the data that is available can be hard to trust. Today, I’ll walk through the main search term databases that are available today, and discuss the specific pros and cons of each one.

All search term databases are affected by a certain amount of skew. The main problem is rank checking applications like WebPosition, which submit automated queries to multiple search engines for large lists of search terms. Every time someone checks their rankings (even by searching manually), it inflates the count for that search term at that search engine… and sometimes at others as well.

The first tool most folks use is Overture’s search term suggestion tool (Google it, I’d link but they’ve changed the URL more than once). It’s free, so it’s popular. Unfortunately, “free” is the best thing you can say about it if you’re planning to use it as a keyword research tool for SEO. Why is it so hard to trust for SEO?

Skew in the Overture tool: Pretty much all rank checking applications will hit the major search engines, and because Overture’s ads are carried on two of them (MSN and Yahoo), every rank check counts as 2 searches to Overture. Other applications that check PPC bids may also run queries on Overture.com, further inflating some numbers. Overture also has partners like Claria serving up search results on pop-up and pop-under ads, search results displayed on expired domains, etc. These all count as “searches” to Overture, even though they don’t really represent a person conducting a web search.

Search terms in the Overture tool: Because they are purely a pay-per-click service, Overture does some things to search terms that aren’t really helpful if you’re using the tool for SEO. Singular and plural versions of a search term will be combined into one, which is important because many times only one (singular or plural) will be really relevant for a web site. Some long search terms may actually be combined – such as “honda car red” and “red honda car.” The search term displayed on Overture’s tool may actually represent a composite of many search terms. This matters little to PPC ads, but it’s a deal-breaker for SEO.

Most professional search engine marketers use the Wordtracker keyword database these days. This database is compiled out of the prior 60 days worth of searches on the Dogpile and Metacrawler metasearch engines, which reduces a lot of the skewing caused by rank checking, since most rank checkers don’t bother with metasearch engines. (Metasearch engines combine the results from several search engines, so their rankings don’t really represent anything that’s actionable for a search engine marketer).

Because Wordtracker’s data is relatively “clean” when compared to the others, we use it in a lot of ways, from helping us identify search terms, to assessing the relevance of search terms. Wordtracker also provides competitive data from many search engines, including pay-per-click bid prices from Overture.

A relative newcomer is the Keyword Discovery database, which is operated by Trellian, the parent company of the Priority Submit paid inclusion service. Trellian’s database is unique in that they have over a year’s worth of data. This allows marketers to search for keywords that are seasonal in nature – if you need to know what popular search terms were for Valentine’s day gifts, but it’s November, you won’t get that data anywhere else.

Keyword Discovery’s database is very large, containing over 11 billion searches, from… well, “from where” is something we don’t know and they can’t disclose. As a result, we don’t really have as much trust in the search counts provided by this database, or even the data on seasonal trends, since we have no idea how many search terms are in the database for a given month. Since we don’t know the size of the database for a particular month, it’s very hard to project results of a search engine marketing campaign – there’s simply no way to get from their count to an estimate of how many searches will take place in the next month.

Aside from having seasonal search terms (even with unreliable counts, it’s better than nothing!), the major advantage Keyword Discovery has over Wordtracker is the tools that they’ve developed to help marketers carry out research. These include an excellent “related terms” tool, and a URL analyzer that will extract search terms from a web page and present the list along with the actual counts from the database.

MSN’s bCentral also has a keyword research tool offered with their monthly subscription service. Unfortunately, users must jump through so many hoops to get to it, and the data provided is so shallow, that I can’t recommend it at this point. I will keep an eye on it, though, and let you know if it gets better.

My next post will cover the recent elections at SEMPO, the Search Engine Marketing Professional Organization, then we’ll move back into keyword strategy with a look at ways to assess the relevance of search terms.

Free book: Jump Start HTML5 Basics

Grab a free copy of one our latest ebooks! Packed with hints and tips on HTML5's most powerful new features.

  • http://www.themesforge.com ct_roy

    while tools like wordtracker do provide a good guestimate for finding which way the wind is blowing for keywords – results can wildly vary from tool to tool.

    another good way of getting some real good indicators of keyword popularity is to play with adwords and discovering ppc costs for keyword combinations – moreover – running temporary campaigns with different keyword combinations can give you real raw data quickly (if u have a few market research pennies to spare with adwords)

    plus – you never know you might – make a sale!

  • http://www.5staraffiliateprograms.com 5StarAffiliates

    Another tool I like is the KW tool at Digital Point:

    http://www.digitalpoint.com/tools/suggestion

    It’s good for quick checks if you don’t have a Wordtracker account since it pulls from both WT and OVER.

    Plus this site is pretty awesome and has over 99 SEO tools. I have heard good things about some of the tools listed.

    http://www.seocompany.ca/tool/seo-tools.html#link-popularity-tools

  • http://www.craigmclaughlan.com/ lokee

    espotting can be helpful and they offer their service in spanish as well. if yu’ve never done seo for a spanish site you probably don’t realise that there are very few tools available in english generally aren’t in spanish, or are poorly developed.

  • ady_salisbury

    I’ve just bought the Search Engine Marketing Kit and thoroughly recomend it! Good job Dan ;-)

    I have been using Overture for my keyword research and hadn’t realised the issues until reading these comments just now in Ch2.
    My problem is that WordTracker doesn’t let me search UK databases and when you’re trying to optimise “Car hire/Car rental” for UK customers and determine which is most commonly used, I get a biased result.
    Any suggestions???

  • Julie – free keyword marketing online tool

    Hey there everyone,

    Just thought I would pop in here and
    share real quick.

    All the thoughts, tools and ideas
    presented are absolutely terrific.

    There is just ONE big huge gaping
    hole with all the free keyword tools
    that services have created to fill
    the void of the disappearance of
    the Overture tool.

    And that is . . . (drum roll please)

    Every single FREE keyword tool has
    NO capability of saving your keywords
    in a basket and managing your projects.

    Well — since July of 2004,
    NicheBOT Classic has been
    providing its constantly growing
    userbase the ability to save their
    keyword searches that are done for
    free.

    =====> http://www.nichebotclassic.com

    I know — it’s okay to feel your
    heart pitter-patter and get excited
    like a kid in a candy story.

    And I’m sure you would agree…

    That’s not only what I call
    “useful” — but I call that an
    awesome solution!

    You can create a FREE account
    right here:

    http://www.nichebotclassic.com/members/signup.php

    Time to manage your FREE keyword
    searches better, don’t ya think?

    And don’t be surprised if you find
    spreading the news to your friends
    and business acquaintances about
    this clearly useful resource.

    Enjoy!

    Best wishes,

    Julie Akerson, Support Services
    NicheBOTclassic.com

    P.S. If you ever have any questions
    that I, or my team, can handle, please
    let us know at nichebotclassic {AT} gmail.com