301 REDIRECTS, GOOGLE INDEXING AND SUCKINESS

Paul Carpenter 30th November 1999
Paul Carpenter

We yield to no-one in our admiration of Google. As a marketing proposition, a website and a business model, Google remains pretty peerless. But that doesn't mean that they are free from problems - and sometimes quite serious ones.

OK. So What's the Problem?

Our current main website address is www.clearsitemarketing.co.uk but - like many companies - we bought several sound-alike and spelling-alike domains to cover the various variations of our name (principly to do with the confusion between "clearsite" and "clearsight").

We've been carefully following our own advice (and Google's) about creating quality, unique content and trying to build links through natural, legitimate means. As a result, we were ranking for a few nice niche terms and getting a bit of targeted traffic as a result. But then, along came a spider. A Google spider, to be exact.

At some point, it decided that some content that had happily lived on our main domain for months actually belonged on one of our other domains. So, for example, some content was relisted as belonging to www.clearsightmarketing.co.uk. Ouch.

Screenshot of Google's results page showing incorrect domain name

As a result, the pages were no longer ranking, as that domain name has no presence or links. So much so that both of the pages listed at that domain were also made supplemental at the same time.

Annoying.

In Practical Terms What Does This Mean?

If this happens to you, then pages that are mysteriously reassigned to a domain alias will stop ranking. If those are mission-critical pages, then you can wave goodbye to revenues (fortunately, this doesn't apply in our case).

Just imagine if your high-profile Welsh Nose Flute landing page is shunted to another domain. All those visitors, hot to trot with cash at the ready are now going to Rival A and you're up the swanny.

What Can You Do About It?

Try telling Google

Firstly, assuming you have a Google Webmaster account, you can log in and actually tell them which domain you'd like them to use. Apparently submitting a site map and confirming access to the domain isn't enough to avoid mistakes.

We actually did this months ago - to no effect - so don't expect miracles. Anyway - it's an option that's open to you in the interests of playing by Google's rules.

Screenshot of a page from Google Webmaster Tools

301 the domain

In geeky terms, '301' just means 'tell the machine looking at this page that it has been permanently moved to another location.' It's a technique most frequently used when you're launching a new site on an old domain.

In practical terms, if you're using an Apache webserver, you can use the power of the .htaccess file to repoint the incorrect domain to the right one. It's a bit technical to read up unless you're of that proclivity - but in case you are, here are the lines of code that you need:

RewriteCond %{HTTP_HOST} incorrectdomain.com$   [NC] 
RewriteRule ^(.*)$  http://www.correctdomain.com/$1   [R=301]

If you don't know your way around a .htaccess file - we strongly recommend not tinkering yourself, but getting your website agency to do the work for you.

Link to the offending pages

In our case, not only have the pages been moved to the wrong domain, but they've also been made 'supplemental'. There's nothing intrinsically 'bad' about supplemental pages, but it does mean that they get crawled very infrequently. In effect, they may not get checked again for many months. This means that our fancy 301 won't even get picked up and we're in a right pickle.

However, this page will be crawled within a few days of going live. By putting links in this article to the incorrect pages, the theory goes that Google will follow those links and discover that they've been moved to the proper domain name.

It sounds good on paper and, to prove that we're happy to practice what we preach, here are those links in full:

Phew!

Delete the page, recreate the content on a new page

Without messing about too much, it is pretty simple to delete the page that is getting listed on the wrong domain and just recreate it at a new URL. When the new page gets picked up.... bingo! Well, in theory, anyway.

But! If you simply copy the page content, then it will look like duplicate content to Google and very likely won't be given any rankings as a result.

We recommend you do not try this method of fixing the problem.

Today's Moral

We all wish that getting and maintaining good rankings was just a case of having great content and doing some work to develop interest in your company. Behind the scenes, there are lots of potential pitfalls, and getting around or out of them isn't always that straightforward. A good website marketing company (hint, hint!) will be keeping an eye out on your behalf, and will know how to address them.

We'll revisit this topic in a couple of weeks and let you know whether our tactics have worked.

Notes and Queries...

Dudes that .htaccess could be better.

You should test false for the correct domain, not for an incorrect domain. Example:

RewriteCond %{HTTP_HOST} !^www.correctdomain.com$ [NC]
RewriteRule ^(.*)$ http://www.correctdomain.com/$1 [R=301]

That way you can point everything to one root and forget about it.

Dan says hi, by the way.
Robin Haswell 29th June 2007
Hi Robin

Cheers for that - had a blonde moment there, didn't I? Still, it was a Friday...

Hi to Dan in return!
Paul Carpenter 2nd July 2007
Chortle. :-)

You should stick to being fantastic at marketing Paul and leave this to the likes of Ben - www.9xb.com/ben_aylott.html.

I sincerely hope this is the first and last time I see any mention of programming on our blog; you didn't even mention Razzle magazine once. For shame.
Paul Evison 2nd July 2007
Ben's too busy having green letters projected onto his face by a monitor and fighting in extreme slo-mo to waste time with my trivial problems.

Speaking of 'Razzle' - did you know we're #4 in 'pages from the UK' for the phrase 'Razzle magazine?' I'm not sure this Google's all it's cracked up to be... any idea how we can sell our services to the kind of people who actually read it?
Paul Carpenter 2nd July 2007
Actually, there *is* a reason we can't use the .htaccess you suggested, Rob.

We're doing some direct marketing and using a separate domain name pointed to this one with a landing page and so on. If we do a catchall 301 then obviously that won't work, so we're having to do them individually.

I *knew* there was a reason. I'm being soooo slow this week.
Paul Carpenter 5th July 2007
Ah, fair enough (for you)

(you could use a RewriteCond for that though)

-Rob
Rob 5th July 2007
 
ADD YOUR COMMENT

Are you human? (sorry to ask!)
Please answer this question in the box below:

OTHER ARTICLES


THINK TANK
  • How to Reindex Your Website Quickly in a Search Engine
    "I think you are right Paul about reindexing. Effectively, good links are the first step to this goal. I have the same problem with this value site: http://www.referencefatburner.com/"
    Georges Junior
    How to Reindex Your Website Quickly in a Search Engine
    "Let's see if this helps with the problem i have been having. http://www.atomsolutions.org Sorry for spamming site"
    Adam
    Search Engine Optimisation (SEO) - No Secrets. No Mystery.
    " Hi everyone, starting, or have a small business? and want more customers? check out http://adwido.com a free site for uploading video ads for your business,they also have image uploads. The more sites you can link to the greater your market will be. They have a free link exchange as well. Don't get left behind, check us out for more info."
    Brian
    What Makes a Good E-Commerce Website?
    "Great Article Zoe"
    Rob Abdul Exommerce Expert
    Why is Content So Central to SEO?
    "I have used this nifty tool before with this current site: http://www.floridamlsconnct.com www.floridamlsconnect.com its great for tracking google ranks, and preparing and testing keywords and meta tag titles. "
    Using the Butterfly Effect
    "This story is a great read, every little bit does help in teh big scheme of things. I have done some updates to: http://www.floridamlsconnect.com www.floridamlsconnect.com and it is taking a while for it to be reindexed. "
    Jon
    How to Reindex Your Website Quickly in a Search Engine
    "I have the same problem with a site I have done updates to a while back: http://www.Floridamlsconnect.com www.floridamlsconnect.com and so far it is taking a bit of time for the site to become reindexed. Hopefully we will find a solution soon. "
    Jon
    How to Reindex Your Website Quickly in a Search Engine
    "Thanks, let me see if this works for me... http://www.joshuahowden.com"
    Charles Howden
    How to Reindex Your Website Quickly in a Search Engine
    "I have the same problem too. I registered a domain http://www.help4shoppers.com about six months back but I did not use it immediately and just left it there because my girlfriend was busy. She plans to use this domain to host her shopping guide and shopping tips forum. Shopping is an obsession of her's and believe me, she's really good at it. I did a site: but google came up empty, so it looks like my domain got de-indexed because I left it empty for too long?"
    JohnnyB
    Search Engine Optimisation (SEO) - No Secrets. No Mystery.
    "Hey starting, or have a small business? and want more customers? check out http://adwido.com Its a free site for uploading video ads for your business, they also have image uploads to. They have a free link exchange as well. The more sites you can link to the greater your market will be. Give it a try you wont be disappointed. We will send u in the right direction. "
    Brian

Get in touch

View our portfolio