Google reach 9,5 billion pages Options

[Allergic]

The search for the word "the" now give you a 9,58 billions pages ! Wow, a 33% increase in less than 15 days. Here a screen shot !

[bwelford]

Well spotted, Allergic.

Of course the Google Search Page still shows:

©2004 Google - Searching 4,285,199,774 web pages

So where do all the other 'the's appear? :?

[Adrian]

There's been some talk of Googlebot crawling sites more heavily than before in the last month. I've noticed it here at work. Could well be they have been expanding the index.

From where I am though, I get

Results 1 - 10 of about 6,160,000,000 for the

So guessing it's only some datacentres or something.

[SEbasic]

I'm getting the 9.58b

Allergic, thanks for pointing this out

[Black_Knight]

Check your preference settings, Adrian, to ensure that you haven't asked for only pages in English.

The biggest change is in how Google is handling 302 redirects. It used to list nothing but the url, and have nothing cached for a URL where there was a 302 redirect. Now it is caching the page that the redirect points to, from the url where the 302 redirect is. But it now seems to have messed up on 301 redirects. Its like they got it backwards.

For an example of this check the cache of the URL for Overture.com
http://www.google.co.uk/search?q=cache:www...w.overture.com/

http://www.google.co.uk/search?q=overture
Note that google is now showing a snippet, not just a description for the Overture root domain. It also has a 'cached' link.

[Allergic]

Each year Google have a november's surprise for us :
Nov. 2001 -> Indexing the Office document
Nov. 2002 -> Huge PageRank change
Nov. 2003 -> The famous Florida update
Nov. 2004 -> He have to dig to see what that number meen and we probably see another surprise soon

[Respree]

There's been some talk of Googlebot crawling sites more heavily than before in the last month. I've noticed it here at work. Could well be they have been expanding the index.

I'd agree with that. Googlebot has been tearing up my site in the last 3 weeks.

100,000 hits (3 gig/transferred) in the first 9 days of November.

[Allergic]

On a medium site (6k) I got a 25% increase (2k) on the number of indexed pages.
On a big site, I got more than 15,000 new pages indexed just for the subdomain I checked yesterday;-)

[Adrian]

Check your preference settings, Adrian, to ensure that you haven't asked for only pages in English.

Had already fallen for that one Ammon, to begin with it was saying about 6.6million

That firgure I mentioned in my previous post was for all languages, though I'd have to double check to confirm that no other options were selected.

[reciprocal]

No doubt.. Google has been ripping my sites apart as well. Doing some intense crawling. Makes me wonder what they have instore for us all this coming year.

[webcertain]

The biggest change is in how Google is handling 302 redirects. It used to list nothing but the url, and have nothing cached for a URL where there was a 302 redirect. Now it is caching the page that the redirect points to, from the url where the 302 redirect is. But it now seems to have messed up on 301 redirects. Its like they got it backwards.

I'm not sure I understand the serp for overture..
1st result: www.overture.com (302 redirect to http://www.content.overture.com/d/)
2nd result:
http://www.overture.com/d/about/advertisers/ (302 redirect to http://www.content.overture.com/d/)

With many hostings company using 302 for their standard redirect, and if Google prefers to pick the redirected url, it's going to be :onfire:

[beitemiller]

Gbot has definatly been tearing through the web. Not sure what it is all about...

[Paul_H]

Googles index doubles to 8 billion pages
http://www.google.com/googleblog/

[webcertain]

For the best ??
I fear that the number of supplemental result will have more than double :?

[ILoveJackDaniels]

Permalink to the Googleblog announcement

[bwelford]

You can also see the following at the bottom of the Google Search Page:

©2004 Google - Searching 8,058,044,651 web pages

[RobV]

Most of the sites I monitor had a huge increase in number of pages indexed (using "site:www.domain.com") over the last 2 days - some doubled. It makes me think there might be something to all that talk about google recreating their index.

[tosheroon]

...and finally our old friend the bicycling guitarist no has 231 pages indexed
all supplemental! :shock:

[Allergic]

...and finally our old friend the bicycling guitarist no has 231 pages indexed all supplemental!

All supplemental !
I hope so reading is code.

When you use in all your pages relative links to your sources but absolute links to outside images, to some contents and some metatag, I don't trust thoses sources !!!

[bwelford]

It's all still confusing however. Despite the vast increase in pages, the link: search for my website still shows 578 web pages, which it has for the past few weeks. Prior to that it always showed 1080 web pages. :?

Again a web page that used to appear at #80 for a keyword phrase now does not appear in the first 1000 for that same keyword phrase. OK perhaps that's what it should be in an enlarged database but it does seem very surprising.