Reply to this topicStart new topic
> Is There A New Googlebot Ip

Star Member

Group Icon
Group: 1000 Post Club
Joined: 10-March 05
Posts: 1,065
From: Montreal Canada
post Mar 6 2007, 03:13 PM
Just noticed in my logs that Googlebot is crawling out of Godaddy IP addresses [208.109.8.2xx]. All of December 2006 and now since February 2007. My site just happens to be on Godaddy servers.

Anyone else noticed this? Or is it fake?
Offline Go to the top of the page

Hall of Famer

Group Icon
Group: Hall Of Fame
Joined: 3-November 05
Posts: 3,461
From: CHeeseland
post Mar 6 2007, 03:15 PM
Did you verify it? There are a lot of people surfing as a Googlebot, you'd be surprised biggrin.gif

John
Offline Go to the top of the page

Membership Admin & Moderator

Group Icon
Group: Membership Admin & Moderator
Joined: 30-September 05
Posts: 3,267
From: Some round-ish rock floating in a vacuum.
post Mar 6 2007, 03:17 PM
<shamelss link drop>
SE Bot Authentication in PHP
</shameless link drop>

Basically it is a code implementation of the page John linked to above.

Pierre
Online Go to the top of the page

Star Member

Group Icon
Group: 1000 Post Club
Joined: 10-March 05
Posts: 1,065
From: Montreal Canada
post Mar 6 2007, 03:36 PM
Yes I did. ARIN tells me the block belongs to GoDaddy and the IP acts like a robot by just getting the pages (php/html) and nothing else. It does ID itself as "Mozilla/5.0 (compatible; Googlebot/2.1;"

I know the agent can be spoofed and if it came from China or Korea then I would understand (and not be surprised).

Offline Go to the top of the page

Hall of Famer

Group Icon
Group: Hall Of Fame
Joined: 3-November 05
Posts: 3,461
From: CHeeseland
post Mar 6 2007, 05:04 PM
Hi Bob
It's likely some script hosted on a GoDaddy server by someone who wants to crawl the web scrape content from other people's sites. Google certainly does not host their crawlers within GoDaddy's IP space smile.gif.

If you are worried about scrapers (or if the load is too high), I would block the IP or even the IP range.

Also, you might want to consider contacting GoDaddy's abuse department to report this issue - though you probably shouldn't expect too much wink-2.gif - it might be a local proxy that is used within their hosting network and might have been used by any of the sites they host... hard to track (hard=probably not interesting for them unless you are a "big name").

John
Offline Go to the top of the page

Star Member

Group Icon
Group: 1000 Post Club
Joined: 10-March 05
Posts: 1,065
From: Montreal Canada
post Mar 6 2007, 05:30 PM
Just analyzed all my data. Only 164 pages read.

Guess it's no big deal but I will try the trick of blocking just for the practice.

QUOTE
consider contacting GoDaddy's abuse department to report this
Yea right. I agree, I could probably get more response from the wall in front of me.
Offline Go to the top of the page
Fast ReplyReply to this topic Start new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:
Jump to Forum:
 
Lo-Fi Version Time is now: 9th February 2010 - 04:36 PM
Meet our Moderators: cre8pc : projectphp : sanity : Black Phoenix : bwelford : EGOL : Ruud : rustybrick : AbleReach : swainzy : joedolson: eKstreme: dazzlindonna : SEOigloo: iamlost : RisaBB
Cre8asite RSS Feed