301 REDIRECTS, GOOGLE INDEXING AND SUCKINESS

Paul Carpenter 1st January 1970
Paul Carpenter

We yield to no-one in our admiration of Google. As a marketing proposition, a website and a business model, Google remains pretty peerless. But that doesn't mean that they are free from problems - and sometimes quite serious ones.

OK. So What's the Problem?

Our current main website address is www.clearsitemarketing.co.uk but - like many companies - we bought several sound-alike and spelling-alike domains to cover the various variations of our name (principly to do with the confusion between "clearsite" and "clearsight").

We've been carefully following our own advice (and Google's) about creating quality, unique content and trying to build links through natural, legitimate means. As a result, we were ranking for a few nice niche terms and getting a bit of targeted traffic as a result. But then, along came a spider. A Google spider, to be exact.

At some point, it decided that some content that had happily lived on our main domain for months actually belonged on one of our other domains. So, for example, some content was relisted as belonging to www.clearsightmarketing.co.uk. Ouch.

Screenshot of Google's results page showing incorrect domain name

As a result, the pages were no longer ranking, as that domain name has no presence or links. So much so that both of the pages listed at that domain were also made supplemental at the same time.

Annoying.

In Practical Terms What Does This Mean?

If this happens to you, then pages that are mysteriously reassigned to a domain alias will stop ranking. If those are mission-critical pages, then you can wave goodbye to revenues (fortunately, this doesn't apply in our case).

Just imagine if your high-profile Welsh Nose Flute landing page is shunted to another domain. All those visitors, hot to trot with cash at the ready are now going to Rival A and you're up the swanny.

What Can You Do About It?

Try telling Google

Firstly, assuming you have a Google Webmaster account, you can log in and actually tell them which domain you'd like them to use. Apparently submitting a site map and confirming access to the domain isn't enough to avoid mistakes.

We actually did this months ago - to no effect - so don't expect miracles. Anyway - it's an option that's open to you in the interests of playing by Google's rules.

Screenshot of a page from Google Webmaster Tools

301 the domain

In geeky terms, '301' just means 'tell the machine looking at this page that it has been permanently moved to another location.' It's a technique most frequently used when you're launching a new site on an old domain.

In practical terms, if you're using an Apache webserver, you can use the power of the .htaccess file to repoint the incorrect domain to the right one. It's a bit technical to read up unless you're of that proclivity - but in case you are, here are the lines of code that you need:

RewriteCond %{HTTP_HOST} incorrectdomain.com$   [NC] 
RewriteRule ^(.*)$  http://www.correctdomain.com/$1   [R=301]

If you don't know your way around a .htaccess file - we strongly recommend not tinkering yourself, but getting your website agency to do the work for you.

Link to the offending pages

In our case, not only have the pages been moved to the wrong domain, but they've also been made 'supplemental'. There's nothing intrinsically 'bad' about supplemental pages, but it does mean that they get crawled very infrequently. In effect, they may not get checked again for many months. This means that our fancy 301 won't even get picked up and we're in a right pickle.

However, this page will be crawled within a few days of going live. By putting links in this article to the incorrect pages, the theory goes that Google will follow those links and discover that they've been moved to the proper domain name.

It sounds good on paper and, to prove that we're happy to practice what we preach, here are those links in full:

Phew!

Delete the page, recreate the content on a new page

Without messing about too much, it is pretty simple to delete the page that is getting listed on the wrong domain and just recreate it at a new URL. When the new page gets picked up.... bingo! Well, in theory, anyway.

But! If you simply copy the page content, then it will look like duplicate content to Google and very likely won't be given any rankings as a result.

We recommend you do not try this method of fixing the problem.

Today's Moral

We all wish that getting and maintaining good rankings was just a case of having great content and doing some work to develop interest in your company. Behind the scenes, there are lots of potential pitfalls, and getting around or out of them isn't always that straightforward. A good website marketing company (hint, hint!) will be keeping an eye out on your behalf, and will know how to address them.

We'll revisit this topic in a couple of weeks and let you know whether our tactics have worked.

Notes and Queries...

Dudes that .htaccess could be better.

You should test false for the correct domain, not for an incorrect domain. Example:

RewriteCond %{HTTP_HOST} !^www.correctdomain.com$ [NC]
RewriteRule ^(.*)$ http://www.correctdomain.com/$1 [R=301]

That way you can point everything to one root and forget about it.

Dan says hi, by the way.
Robin Haswell 29th June 2007
Hi Robin

Cheers for that - had a blonde moment there, didn't I? Still, it was a Friday...

Hi to Dan in return!
Paul Carpenter 2nd July 2007
Chortle. :-)

You should stick to being fantastic at marketing Paul and leave this to the likes of Ben - www.9xb.com/ben_aylott.html.

I sincerely hope this is the first and last time I see any mention of programming on our blog; you didn't even mention Razzle magazine once. For shame.
Paul Evison 2nd July 2007
Ben's too busy having green letters projected onto his face by a monitor and fighting in extreme slo-mo to waste time with my trivial problems.

Speaking of 'Razzle' - did you know we're #4 in 'pages from the UK' for the phrase 'Razzle magazine?' I'm not sure this Google's all it's cracked up to be... any idea how we can sell our services to the kind of people who actually read it?
Paul Carpenter 2nd July 2007
Actually, there *is* a reason we can't use the .htaccess you suggested, Rob.

We're doing some direct marketing and using a separate domain name pointed to this one with a landing page and so on. If we do a catchall 301 then obviously that won't work, so we're having to do them individually.

I *knew* there was a reason. I'm being soooo slow this week.
Paul Carpenter 5th July 2007
Ah, fair enough (for you)

(you could use a RewriteCond for that though)

-Rob
Rob 5th July 2007
 
ADD YOUR COMMENT

Are you human? (sorry to ask!)
Please answer this question in the box below:

OTHER ARTICLES


THINK TANK
  • Web Design Yorkshire - Local Maps Fail
    "I think they must have been reading! That spurious result is history as of yesterday...."
    Paul Carpenter
    Why I Don't Rank For Zoe Piper
    "Hi! Zoe's page has always been titled for 'Zoe Piper' (check the Google index for the page) so I'm guessing it must have been a momentary database fail or something when you were looking Atom. I don't think the 'use your name many times in the body' advice is going to cut the mustard though. It used to work once upon a time, but if it were that easy (and I guess you're hinting at keyword density here) then it would be *easy* to rank for anything and we'd all be millionaires :) The thrust of Zoe's point is that www.zoepiper.com is a content free holding page, with no links and essentially of no value for anyone searching for 'Zoe Piper'. Google could show any other result from the first page of the SERPS at the top and it would be more relevant and useful..."
    Paul Carpenter
    How to Reindex Your Website Quickly in a Search Engine
    "same problem i am having with my new site updates at http://www.tmc.edu.sg sheesh .... "
    BBC
    Google and UK Spelling: 'Optimisation' vs 'Optimization'
    "Australia supports your crusade! pufft realizing indeed"
    Ian
    Why I Don't Rank For Zoe Piper
    "Hi Atom, I should really check my meta tags - thought they'd populate by default tbh! It's interesting with something like this to see how different factors are weighted, from URL to internal links to meta tags etc like you say. Unfortunately I can't go overboard on my profile page, it has to be short and sweet so on-page content is pretty much a no-no! Ah well...if people want me they'll find me. Thanks for the comment :)"
    Zoe
    Why I Don't Rank For Zoe Piper
    "Hi Zoe, There are some major reasons your not ranking. Your Meta tags say ""My Default Keywords". Also your name appears once in your profile page and the other time it does it is an image so that doesn't help. I bet if you added your full name to your profile some more times it would put you up in rankings. Also LinkedIn will has your name on one page over 50+ times so you need alot more usage to compete. But that is the way it goes. This is only a profile so I am sure you're limited. Despite having loads of content linked to your profile, Google also wants to see the relevance of Zoe Piper on this page and is only seeing it once. "
    Atom McCree
    Web Design Yorkshire - Local Maps Fail
    "I guess they do have quite a lot of services no-one uses...."
    Zoe
    Web Design Yorkshire - Local Maps Fail
    "Yet another useless, half arsed service from Google. "
    The Floating Frog
    “Cloaking” Content for SEO (Or What Happens When Your SEO Company Isn’t Telling What They’re Up To)
    "I thought these techniques died out with Windows 98', these people need to find a new career. Nice writeup BTW"
    The Floating Frog
    Web Design Yorkshire - Local Maps Fail
    "I've noticed this a lot recently - stupid map results like this that basically hand over a big slice of the search market to one company on the basis of what is (presumably) a bug. Fortunately, long term we're repositioning as a 'digital agency' in Leeds/Yorkshire because our portfolio offering is much wider so who cares ;-)"
    Carps

Get in touch

View our portfolio