What is keyword cannibalisation?
Keyword cannibalisation occurs when multiple pages on the same website are targeting the same keyword phrase or group. This results in lower Google rankings for the collection of pages as a whole, than if you had one page targeting the phrase or group, hence the name cannibalisation.
Why is keyword cannibalization a problem?
The main problems that occur are:
- Diluted SEO Effectiveness - your internal link equity is spread across every competing page, but only one will end up ranking for the terms.
- Lower Conversions - often the page you did not intend to rank will rank for your keyword, where the content could be less well optimised for your desired conversion action. This means the user isn't satisfied, resulting in a higher bounce rate, and lower rankings all together!
- Wasted Crawl Time - Google has a finite amount of dedicated time for your website, and wasting it on competing pages makes it less likely to crawl your higher priority pages.
It can be tricky to find your competing pages, especially on an established website such as a large e-commerce website, which can have historical categories and informational pages created by previous agencies or in-house developers.
How has keyword cannibalisation changed moving through 2016?
Google is trending towards ranking less pages for more keywords, and with the introduction of rankbrain, they can test whether this is better or worse for the user.
They now prefer to rank larger pages that target multiple phrases at once, and have really good user experience signals for all queries, whether that's a long tail keyword or short tail keyword.
This means that even though it might not be an obvious cannibal page, it may still be competing because Google wants to rank a main category page there instead of a specific page.
The best route forward is to Google your keyword phrases, and see whether the top 4 results are a specific page, or a top level general page ranking there. From here you can map out how your site should be optimised, with the correct keywords connected to the right type of page.
This may seem a little complicated, so let's look at some examples.
Example 1: A Preference Modifier
This is an example of how Google ranks general main category pages for specific keywords. Some may consider this a long-tail to be targeted with a product page, but as we can see Google believes the user wants to see any red office chair, as opposed to one with specifically red wheels.
Example 2: A Specific Requirement
This example shows a case where Google is displaying specific results for this query. They have most likely split tested general and specific results, and decided that users were more satisfied with specific pages about supportive office chairs, therefore that is the type of page you want to target for that query.
Example 3: Commercial Modifiers
This is an example of how Google moves higher up the topic when dealing with commercial modifiers, and is something I've noticed across multiple industries. Once you add commercial modifiers such as "buy, online, next day delivery, etc" to your query, you get presented with a page dedicated to commercial activities, which is often at a higher level than your query.
In our example above, the "office chair" query returns "office furniture" pages.
This is why starting at the SERPs is the best way to begin your website structure mapping process.
Mapping Your Structure
So for each of your keyword phrases, you want to create groups of queries based around users intent.
Then after you have your groups, you need to Google each keyword to see which type of page is brought back.
Then you can decide whether a keyword fits into a specific landing page, or as part of a master page.
Finding The Cannibals
After you have mapped out your ideal site structure, you can identify your current cannibal pages.
There are several ways we can identify competing pages, and it's best to use all of these to find every single one of your cannibals!
- site:domain.com inurl:keyword - using this operator in a Google search can help us find every page on our website which has this keyword in the url. The url is often optimised with the keyword and can help us find potential duplicate pages.
- Visit your sitemap, and do a ctrl + f for your keyword - this will help find all the pages within your sitemap targeting your keyword, helping you find old pages buried within your site that you may not have known about before.
- SEMrush keyword data - this will give you a list of keywords with the page urls that rank for those keywords. It can help identify where you may have the wrong urls ranking for your keywords, which can be the result of cannibalisation.
- site:domain.com intitle:keyword - similar to the first operator, this will show each page with our chosen keyword in the Title.
Doing this for each keyword should easily bring back your problem pages.
How to fix your cannibal pages
First we need to decide if the pages are serving any benefit to the users on our website. From here we can then create two categories:
- Pages that are useful, and require de-optimisation.
- Pages that aren't useful, and require redirection.
De-Optimising Pages
This basically means you want to make these pages less relevant to your cannibal query, by removing the keyword & synonyms from the key areas causing cannibalisation issues.
These are connected to your on-page factors, your on-site factors, and your external factors.
The on-page factors to de-optimise are:
- Page Title
- Meta description
- Url (remember to redirect)
- H1, H2, H3
- Image alt text
On-page factors to optimise are:
- Add exact match internal links in the main body of content from your cannibal page back to the main page.
The on-site factors to de-optimise are:
- Anchor text of internal links
The off-site factors to de-optimise are:
You often will not have control over your inbound linking anchor text, and therefore for a heavily optimised page, it may be better to redirect the page to your main page for that keyword, and create a new url entirely.
Redirecting Pages
For large websites this can become a nightmare, with a htaccess file longer than most peoples PHD.
However it is well worth it in the long run, as removing the cannibalisation will leave you with higher rankings for the entire site.
You want to use the 301 redirect rule, to set the page as permanently moved to the new location, for example:
Redirect 301 /test-cannibal https://domain.com/main-keyword/If you are redirecting sub-category urls as well as the main category, you must have the sub-category redirects above the main category redirect in the htaccess file for it to work, for example:
Redirect 301 /test-cannibal/sub-category https://domain.com/main-keyword/ Redirect 301 /test-cannibal https://domain.com/main-keyword/And after you have completed this htaccess file, make sure to remove all internal links to the old pages, and remove them from any sitemap, both html and xml sitemaps.
Final Thoughts
There you have it, the complete guide to sorting out your pesky cannibalisation issues. Some have said recently that cannibalisation is a historical problem from a by-hone era, but I have to politely disagree.
With Google's trend towards ranking larger pages that satisfy a broader user intent, cannibalisation is actually more common now than it ever was.
The key is to always start from the SERPs, and work backwards, as this shows what Rankbrain already considers to be the ideal solution for the user.