Register
Forgot Password?
Score
-
-
-
  /100
Certificate
SEO Certificate

1.2.2 Shortlist your keywords

Sorry, you are not logged in. Please login to get full access to this page or register if you're not registered yet.

Now you have a long and versatile list of keywords and keyphrases to choose from.

For my little son this would be enough, but we're after something much bigger than pocket money. Thanks, Andy, now your dad has to make a final decision. Alas, it's always dad who bears the burden of responsibility. ;)

So let's brush aside all stuff and shortlist your search terms. Again, you can choose between a free but long way to do this, or use Rank Tracker tool you already know to make this task a snap.

Option 1: Sweep away the keyword trash, by hand

Calculating KEI

Here we go with the magic wand of SEOs. That's the SEO know-how called KEI, or Keyword Efficiency Index. This index shows you how good a keyword is for bringing traffic to your site.

You need keywords with high KEI.

Here's what the importance of your keywords depends on:

  • Relevance (R): it is how closely your keyword is related to what you offer to your customers.

We use the three-grade scale to estimate relevance. So now you need to make a separate column for Relevance in your spreadsheet, and put one of the following numbers next to each word or phrase:

  • 1 for Excellent
  • 2 for Good
  • 3 for Poor
  • Search Volume (Sv): it is how many queries are made for a keyword per month.

Here's how you can check Search Volume for each word or phrase: go to Wordtracker and type in your search term, say free ecard. Wait a while, and along with keyword suggestions, you'll see number of searches per month.

Free Wordtracker keyword research tool
Free Wordtracker Keyword Suggestion Tool

Just like you can see on this picture, people search for free ecard 11384 times per day, or about 347201 times per month.

Now, in your spreadsheet, make a column for Search Volume and enter the number of searches values for each phrase.

  • Competition (C): that's how many websites are already more or less optimized for this keyword. Generally, all sites that have the same keyword as you are your online competition. And the fewer websites are optimized for the same keyword, the better KEI this keyword has.

The way to check competition is simple. Enter the keyword in Google and click to search. Now look at the image below to see where you find the Competition value:

Google competition
Google competition for the free ecard keyword

In a separate column for Competition in your spreadsheet, enter values for each keyword.

Here's how your table will look:

Excel data for Keyword Efficiency Index
Relevance, Search Volume and Competition Values in Excel worksheet

So what makes a KEI better? Higher relevance, higher search volume, and smaller competition.

Now, let's count the magic KEI number for your keywords.

The classical formula for KEI looks like this:

Keyword Efficiency Index Formula
Keyword Efficiency Index formula

I personally use, and always recommend an improved formula. Use it to get a much better estimation. It takes into account real relevance of your keywords.

Keyword Efficiency Index With Relevance
Keyword Efficiency Index with Relevance

Now make a column for KEI in your Excel spreadsheet and apply the second formula to calculate KEI for each phrase.

Keyword Efficiency Index In Excel
Keyword Efficiency Index in Excel worksheet

Let's choose the best keywords

First, sort all keywords in your spreadsheet by KEI. As I already said, the higher KEI, the better your keywords.

You do not need many keywords to optimize your site for, so look at your list and choose top 5 keywords. Mark them as the major ones (say, color them green.) Then, choose the following 30 and mark them as important (you can color them yellow.) Some more 65 or so keywords should be marked as supplemental (e.g. red.)

Now you've got a nice list. We'll target the green-marked keywords in the first turn, make use of the yellow ones as alternative and mind the red ones just in case.

58 comments

Add comment Hide commentsShow comments

Please log in or register to leave a comment.

2008-07-31 16:41:47: Gerben Bouwhuis

Nice,

But the relevance is to be generated by the user himself, right?

About the competitors settings, why don't use the title, anchor and url appearences too? Or just those?

it's possible that 1.000.000 right about a certain topic on the web. But if your html is correctly build, you only have to take it up to those who have good html also.

It's a thought again.

Answer
2008-07-31 17:12:36: Gerben Bouwhuis

Other question, how do we modify our KEI calculation? Can't change it as i see it?

Answer
2008-07-31 21:30:06: Renaldi Diponegoro

How can we measure relevance ? A 3-grade scale as you described is a rather subjective measure, depends on our personal judgement. How can we categorize that this keyword is 1, while others are 2 or 3 ?

Answer
2008-08-01 09:39:36: Dan Richmond

But the relevance is to be generated by the user himself, right?
That's right. I guess only a human can decide which word combination closer describes what you sell.

Answer
2008-08-04 12:25:48: Dan Richmond

About the competitors settings, why don't use the title, anchor and url appearences too? Or just those?

Gerben, could you make your point a bit more clear? Do you mean keyword checks in allintitle, allinanchor etc.?

How can we measure relevance ? A 3-grade scale as you described is a rather subjective measure, depends on our personal judgement. How can we categorize that this keyword is 1, while others are 2 or 3 ?

Renaldi, unfortunately in this case the only thing that's helpful is your common sence. You put a grade 1-3 depending on how close you think a keyword is to your site's offer and topic.

If you don't want to decide this yourself, you can just use the normal KEI formula I also provided: search volume squared, divided by competition.


Answer
2008-08-08 10:59:32: Drew Stauffer

This is great. I love the Excel tip. I've never taken the time to learn about how to write formulas, but now have one.

Answer
2008-09-18 23:46:11: Anthony Curran

this makes keyword searching much easier to understand and get it down to a duplicable process

Answer
2008-10-03 14:54:07: Steve K.

Hi Dan
Great piece of work here - I particularly like the revised KIE(R).
BUT :-)
How do you arrive at (4-R) over 3?

Much obliged at your insight and excellent tips

Warm regards
Steve K

P.S.
I've only just discovered your website and have been avidly devouring the info all day.
Sorry if the question has already been covered.

Answer
2008-10-06 11:47:56: Dan Richmond

Hi Steve,

thanks for your comment.

How do you arrive at (4-R) over 3?

This all comes from my personal experience. :)

Answer
2008-10-06 14:28:17: Steve K.

Dan - just tell me yay or nay if I'm close :-)

I played with your formula and these where my findings:

If the (R) Relavence chosen is 1 (one) then the formula reverts to normal KEI and the results are the same as if NO Relavence (R) had been used.

If the (R) is 2 or 3 then (R) reduces the KEI to a lesser figure in accordance with your preference.

(R) must be a positive integer between 1 and 3.

Close?

Steve K.
crazy 'bout formulas

stephan dot kassner at gmail

Answer
2008-10-08 11:45:07: Dan Richmond

Hey Steve.
I give a nay - sorry :)

Example:
You've got a site about cats.

You have 3 keywords:
1)cat (Relevance 1, Search volume 3, Competition 7)
2)house (R 2, Sv 3, C 7)
3) dog (R3, Sv 3, C 7)

Now let's count KEI.
1) cat: (4-1)/3*3/7 = 3/7 (around 0,43)
2) house: (4-2)/3*3/7 = 2/7 (around 0,29)
3) dog: (4-3)/3*3/7 = 1/7 (around 0,14)

As you can see, the relevance figure helps determine the most appropriate keyword in the case when # of searches and competition are equal. I chose other numbers equal just to make it more obvious. Without the R factor, it would look as if "cat" and "dog" are equally good for a cat-related sitem which is not true.

You don't need the R figure if you want to know KEI for just one word. The whole point here is to use KEI as a criteria to compare numerous keywords and to select the best ones. The R factor helps greatly, as it helps better compare keywords.

Try to play with real figures and you'll see how this works.

Answer
2008-10-12 11:32:01: Steve K.

Thank Dan!

I see now how it goes together -

Best wishes
Steve K.

Answer
2008-12-07 17:10:18: Aaron Wardle

Hi,

This is a great guide when using word tracker should I multiply the daily total by 30 to get a rough monthly search to use in the formula?

Aaron

Answer
2009-04-02 14:08:07: Donna Goodman

Hi Dan, I don't necessarily agree with the idea that the highest KEI keywords are the best choice in all instances, and I will tell you why I say that. First of all, all the great keywords have been taken with few examples, and probably have very low KEI values, and the "on point, popular" ones that don't have high KEI's don't exist, or have little or no searches done on them.

In my mind it makes no sense to make your number one key word a high KEI valued word, if none or very little searches are being preformed on it? I realize you need WordTrakker to be able to find that information out, but I have always had it.

On the other hand if you have a toy site like I do, and toy/s has a super low KEI because of the competition, I don't think that you want to omit that keyword from being on the top of your list. I think you just have to do a lot more than your competition to rise up through the ranks on that keyword.

I hope I am making my point without trying to destroy the value of the KEI variable. It certainly has its place, but I think you have to take everything into consideration when choosing your highest quality keywords, and that is just one factor of many. IMO

Donna

Answer
2009-04-03 10:30:59: Dan Richmond

@Donna Goodman
I would probably rephrase what you're saying:
KEI is important as a quick (and in most cases helpful) way to choose keywords, but KEI should still be taken as a relevant value.
Besides KEI is really good for a beginner, while of course as long as a person is getting more experience in SEO, she will be able to make more intelligent decisions on profitability of keywords.

Answer
2009-04-03 16:19:17: Donna Goodman

Hi Dan,
I couldn't agree with you more!

Donna

Answer
2009-04-26 00:19:44: Gurpreet Singh

Hi Dan,
interesting formula for relevant KEI(R). In effect you are giving a weightage of 1 to Excellent, 2/3(=67%) to Good and 1/3(=33%) to Poor. What is the rationale behind SV^2/C. Why not simply SV/C

Answer
2009-04-30 02:52:15: Dan Richmond

@Gurpreet Singh

As I keep saying, KEI is a relevant value, which means it works to compare keywords to one another and decide which ones will work best for you.
Therefore, the formula for KEI was invented to better serve the comparison purpose.
Now look what would happen if we had it like you suggest, i.e. simple Sv/C:

1) Search volume = 1
Competition = 3

2) Search volume = 3
Competition = 9

In both cases KEI would be = 1/3 which would make both keywords look equally profitable, which is not exactly right.

Answer
2009-05-08 16:13:45: Webmaster Turtlemail

Loving this book... thank you for the time you have put into it.

I'll admit I scan read it first... before deciding whether it made sense in my logical (at times) head. But after it making so much sense... I'm not going back with a fine toothcomb.

I'm a little confused though. I thought it would make sense to target words or phrases that have high searches but not so many results in Google. Am I oversimplifying it?

I've always relied on common sense. This works extremely well for all of our client sites... and perfectly for one of my blogs (which is at number one in Google for around 80% of the posts made on it). But the site I really need to work on still struggles for anything other than long keyphrases.

Am I barking up the wrong treee here hon?

Answer
2009-05-08 16:15:13: Webmaster Turtlemail

Oops... sorry! I should have proofread it before pressing send.

I meant I AM going back with a fine toothcomb.

Eek!

Answer
2009-05-11 07:26:33: Dan Richmond

@Webmaster Turtlemail

Thanks for deciding to give SEO in Practice a good read!

As for keyword choice, KEI was not invented by me, it's been a useful measurement of keyword effectiveness for years now. And it works better than just taking high-searches, low-competition keywords. Check this page to get more info on that:
http://www.wordtracker.com/database_help/keihelp.html

Answer
2009-05-30 09:51:22: Rose Williams

Hi Dan

Can I use Google Adwords "Keyword Tool" to determine the number of searches on a keyword for the last month? If I do should I use the [exact match] facility?


Answer
2009-06-01 07:54:08: Dan Richmond

@Rose Williams

In the software (I mean Rank Tracker) this possibility will appear only in a couple of weeks. Outside Rank Tracker you can use Google Adwords for the number of searches, and you do not need to use "exact match".

Answer
2009-06-02 09:36:11: Rose Williams

Thanks. I actually did realise that I should be using "phrase match" and not exact match.

I look forward to seeing it in your tool as I feel its more honest in its results.

Answer
2009-06-09 03:08:56: John Atchue

Hey Dan,

Just a little confused about the competition numbers. I though that when researching competition for a specific keyphrase you should enter it as a phrase match ex. "super tasty dog food" otherwise your results will be full of websites that have some of the keywords on them but possibly not others, is that correct or am I wrong?

Answer
2009-06-10 04:54:26: Dan Richmond

@ John Atchue

There is some rationale here but on the other hand, when people search in Google for super tasty dog food, very few will use quotes for the exact match.

Answer
2009-07-27 15:57:45: Stefan Habermeier

Hello Dan! I dont understand why you prefer the "Keyword Efficiency Index with Relevance" and the Rank Tracker uses "just" the Keyword Efficiency Index formula. Did I miss something?

Kind Regards,
Stefan

Answer
2009-07-28 07:21:27: Dan Richmond

@Stefan Habermeier
Pretty simple: Rank Tracker is unable to decide on the relevance :)

Answer
2009-08-03 09:37:31: Daren Emmingham

Hi there Dan,

can i ask what the difference is between using wordtracker to find how many times a keyword has been searched for (per day and then muliplying it by 30) compared to using the google adwords tracker that shows you the global monthy search volume?

Thanks

Daren

Answer
2009-08-07 11:07:47: Dan Richmond

@Daren Emmingham

Google Adwords has already been added to Rank Tracker and now it's the most precise and informative tool to get search volume data, especially if you're optimizing for Google. Besides it works for many languages.

Answer
2009-08-16 15:30:53: Damon Day

I have Rank Tracker sorting through about 200 suggestions from google adwords as I type this.

I have a question. I am a financial consultant. One thing I have been doing a majority of lately is educating consumers about the different options available for getting rid of debt.

In my keyword research I find the most relevant phrase on that topic has a KEI of about 90. The next closest keyword is only a 5 in terms of KEI.

The phrase is very relevant to my site. Does this mean if I narrow it down to a few key words, that this one with 90 KEI is the word I should focus most of my effort on optimizing? This phrase gets over 100K searches per month. what is considered a good KEI number?


Answer
2009-09-07 11:22:39: Matt Hilbert

This is really good - just one comment.

You suggest using Wordtracker to find search volumes, but Wordtracker is based on historical search volumes for search engines outside Google.

Isn't it better to find the search volume by using the Google Adwords Keyword tool instead?

Especially since Google has something like 65% of the search volume market and the results are therefore (1) far more representative of the total search market and (2) produced using current figures rather than historical figures.

Answer
2009-09-08 05:07:24: Sasha-IPR

@Matt Hilbert

Matt, you're right. Hope to get down to rewrite this chapter soon. BTW, the Rank Tracker tool I suggest here is using Google AdWords as the default and recommended tool to check search volume.

Answer
2009-10-22 15:50:02: Everett Patterson

Amazing! I love your brilliant KEI explanation. I've never heard of KEI before, but that's a great idea, and worthy of implementation! Thanks!

Answer
2009-11-09 17:03:17: Emmanuel Parrou

This tool is excellent !

But I have a problem : the website I am using as test is in french, and so I chose french Search Engines to calculate the KEI of my keywords, but I always get 'Not checked yet' in the results column.

One way to have something in this column (not for all keywords though) is to select google.com USA as search engine, but I'm afraid that those KEI results are not usable for France, are they ?

Looking forward to reading soon from you and to continue this excellent ebook, thanks a lot for your excellent work !

Emmanuel

Answer
2009-11-12 08:39:08: Dan Richmond

@Emmanuel Parrou

Please restart your software to let it auto-update. There were algo changes in the French Google - this might have caused the problem. If the update doesn't help, please write to the developer's support at
http://www.link-assistant.com/support/

Answer
2009-12-07 03:32:44: Ken Taylor

Hey! Thank you for clarifying KEI. That was the a question I had from the previous lesson. It's a bit of a challenge using KEI when you might have a fairly 'obvious' list of KW's. For example, say I wanted to create a mini-site (5 to 6 pages) focused around one KW: "Round Plastic Tray", now my list of KW's may include, "Black Round Plastic Tray", "Green Round Plastic Tray"(remember, I want the site to be "super-focused", I'm using an extreme example here), so as long as KEI is in the green I'm good to go. Don't really need to do any calculations.

Have I made an acceptable conclusion?

Answer
2009-12-11 12:11:45: Dan Richmond

Yes, Ken, you're quite right!

Answer
2009-12-28 07:28:07: Paul Watchorn

Just for now, I will let the software do the KEI bit :)

Answer
2010-01-06 09:08:15: Nikolay Gachev

Hey Dan,

Thank you very much for sharing your experience. The book is really helpful!

In his book 'Get to the top on Google' David Viney states that he uses so called KOI (Keyword Opportunity Index) and he thinks it is much more reliable than the classic KEI. He calculates KOI as
KOI = (Sv^2)/P,
where P is Popularity of the keyword (actually P is Google's result when searching in anchor texts only: allinanchor your_keywords).

Obviously your formula gives weight to relevance of the keyword, while David's one uses more concentrated on subject search results. However, having little experience with SEO, I cannot figure out what are the pros and cons of your formula vs David's KOI. Would you mind to clarify this?

Also, which formula uses RankTracker to display KEI? I guess it is the improved one, isn't it?

Answer
2010-01-15 04:02:51: Dan Richmond

@Nikolay Gachev

the "allinanchor" improvement you're talking about lets you find competition among the pages which are obviously being optimized for your keyword. The classical KEI formula works with the competition among pages that are ranked for your keyword. What if a page's owner did not purposefully optimize the page, but it's still ranking? You might miss it if you're using the KOI formula.

Still I'm not 100% againgst KOI here (though not really using it as much as KEI). It rather has to be a matter of your choice.

Also, which formula uses RankTracker to display KEI?

It's using the classical KEI formula (the software would need an AI to estimate relevance wouldn't it;)

Answer
2010-02-01 09:36:50: Ben Neale

I've copied the results that Rank Tracker has generated into a spreadsheet, and created an extra column using the classic formula, and it generated completely different KEI figures.

eg.
keyword: storage sheds
length:2
KEI (Rank Tracker): 214.788
KEI (Classic Formula): 0.238653076923077
Competition: 1300000
Searches: 557
Relevance: 1
KEI(R): 0.239


Am I missing something?

I've also ordered my results byt KEI(R) and at the top of the list I have a high number of keywords that I've marked 3 in the relevance column. As these words clearly aren't relevant to my website, should I just ignore them?

Many thanks

Ben

Answer
2010-02-04 14:15:13: Dan Richmond

@Ben Neale

Which tool are you using to check number of searches? (You can check that in Preferences -> KEI Settings -> Number of searches) I don't see where you can get 557 for storage sheds.
RT is calculed KEI correctly (just checked it on a number of keywords). The point is I don't believe you've got 557 for search volume in Rank Tracker. Please could you check this out?

Answer
2010-02-09 07:04:48: Ben Neale

Hi Dan

I'm not making it up! :D
I can send you the Rank Tracker file if you like!!

I 've worked out the maths now. It seems that RT was giving me daily search volume. If I multiplied that column by 30, it all fell into place.

Regarding the tool. I was using Wordtracker, but I'm now using Google Adwords - which is giving me monthly search volume, and so the maths is making sense.

Answer
2010-02-19 09:43:39: Dan Richmond

@Ben Neale

There's no point sending the file. I see that you've been taking search volume from different sources in Rank Tracker and manually.

Answer
2010-03-24 11:13:36: Tony McCreath

Nice to see someone else factors in the relevance of a phrase.
When working with businesses its no good finding "great" phrases when they don't relate to the market you are in.
I personally called it "conversion rate", as in the chance that it would create a lead/sale, and I score it out of 10.
Another variation is that I change the power used in the search volume, based on how competitive my clients website is (e.g via PageRank).
I also play will several other stats and formulas (like KER which is a logarithmic variation). I mix and match them. They are only clues which a good SEO detective should use to find the jems in the stones.

Answer
2010-03-29 11:57:59: Dan Richmond

I met several people like you who have their own methods - looks like when choosing keywords there's no "absolute" truth - each one of us figures what's best for him. Moreover, sometimes things just come as a surprise when you look up in Google Analytics - and there are keywords you've never expected to see :)

Answer
2010-03-29 23:12:27: Tony McCreath

I like those surprises. My last client got very excited when I was asking about certain searches that were popular, but had little competition. They were new products, which he was thinking about stocking. No brainer now!

I also check out Google Webmaster Tools for hints on keywords.

Answer
2010-03-29 05:12:25: sharon phillips

Hi Dan, im not sure how to apply the fomula to the spread sheet, could you clarify please,
Thanks
sharon

Answer
2010-03-29 11:45:53: Dan Richmond

Check this one:
http://spreadsheets.about.com/od/excelformulas/ss/formula_begin.htm

Answer
2010-05-17 02:58:46: Rockey Killer

This article was Excellent and helped me a lot in writing my article on D-A-D . The only thing I was wondering why din't you considered KOI over KEI ?

anyways i have used KOI based on the relevancy thing. You can check that out here

http://freewebsitetrafficexchange.com/board/index.php?topic=5.0

Thanks for this wonderful article .. :)

Answer
2010-09-01 11:40:58: Dan Richmond

As far as I know Link-Assistant.com are going to add the "allintitle" and "allinurls" parameters in the keyword research section of Rank Tracker at some point in the future.

Answer
2010-07-22 11:41:05: Wendy Sheppard

Hey Dan, thanks for this great resource.

When you update this section, don't forget to include that WordTracker is now reporting search volumes based on YEARLY searches as opposed to the former daily search volume numbers.

Honestly, I don't rely on the WT tool very much. After they changed from daily to yearly search volumes, I used a keyword that had 3000 DAILY searches in January 2009 and found that the same keyword had slightly over 3000 YEARLY searches in April 2010. I just can't see how there could be such a huge discrepancy. So I've concluded that WT is really just garbage.

Answer
2010-09-01 11:48:02: Dan Richmond

Maybe not exactly "garbage" but Google AdWords Keyword Tool is more preferable. Since this chapter was written Google AdWords Keyword tool has been added to Rank Tracker.

Answer
2010-08-18 15:55:14: Gerhard Bayer

Dan, can you outline a strategy to decide between keywords that have a high KEI, but are not very specific to our business, vs. doing it the other way?
Even your weighted formula wouldn’t make much difference, since the difference between potential keywords is so big, e.g. programming (1000000), integration (133000), middleware (5600), IT consulting (1600), SOA architect (64), SOA consulting (9).
What about keywords that have several meanings, e.g. SOAP – most people know it as a cleaning product, but it is also a computer term, so how would you determine the "real" KEI? Strangely enough, the computer related term has the most results on the first couple SERPs.

Answer
2010-08-31 16:52:21: Ivo Valentinov

Hi

Is it a good idea to choose keywords which primarily are in our domain name?

Answer
2010-09-01 11:13:26: Dan Richmond

Rather, the other way around - it's good to have your main keywords in your domain name, yes.

Answer