Been working furiously on my site and now google is not finding 33 pages - previously I had zero 404's. They giving the old 404 error. I noticed this in the Google Webmaster Tools.
Are these pages that where indexed and now there are no pages there? How does it work? I assumed that if there is a link to a page that does not exist it will pick up the 404.
Saschaeh, the first thing is to determine a few things:
- Are those pages still on your server? - Are all the links to those pages correct? - Is it possible that, when Google last visited, they weren't accessible?
If these are important pages, I'd ensure that they're there, and that the links are correct.
If you can pull your server logs, search for the 404s and determine which pages may have incorrect links to them.
This post has been edited by DianeV: Oct 9 2007, 03:59 AM
I agree with DianeV, you need to discover what these pages are and how Google is finding them. If you've moved them, 301 to the new page. It's also a good idea to ask anyone who is linking to them to update their links.
One exception would be if the test folder is for a site that is now hosted on its own domain, and the domain belonged to a customer. I'd consider either forwarding to the customer's domain or a portfolio page on my site that mentioned the customer's domain.
Oh... forever or until they are made obsolete by other changes? I've been pickier about that on sites I own than on sites where someone would need to pay me for line after line of 301, because labors of love tend to have bigger budgets for little nudges.
You can still redirect an entire folder using a single line, as long as the file names are unchanged:
CODE
RewriteEngine on RewriteRule ^domain.com/folder/(.*)$ http://www.domain.com/newfolder/$1 [r=301,nc]
Or something to that effect.
As to how long to keep a 301 in effect? As long as the destination file exists. I don't consider it worth my trouble to check whether a page is still indexed, as long as that page is forwarding to the right place!