Recently indexed pages By Google Options

[Charlie_D]

This tool shows you the files on your web site that have been indexed recently Google. Both new pages that are added or existing pages where content has changed enough for Google to re-index the file.


I stumbled upon this and find it amazingly accurate. You can check day by day to see if a new page or revised page that you made was indexed


http://www.123promotion.co.uk/tools/google...tly-indexed.php



Let me know how you like the tool



Charlie

[Respree]

Great find, Charlie. I can see Googlebot crawling my site, but my analyzer doesn't tell me which ones.

[travis]

Mate,

Top work as usual.

I did not even know you could query Google in such a way, and if I did, I would prefer to use this tool anyway.

Very useful for new clients waiting to see what is happening in terms of getting pages trawled.

I noticed with my newest customer that the front page has been trawled, but nothing else.

Great find.

[bwelford]

Yes indeed, Charlie_D. That's most intriguing.

One word of caution. Don't put a trailing slash after the URL or you'll get no results. So search for www.mysite.com rather than www.mysite.com/

I scared myself for a time with the forward slash at the end since nothing had been indexed for 30 days. Remove the slash and 4 were indexed yesterday. Interestingly I don't know why these four because they haven't changed in quite a while. :?

[travis]

Bwelford,

Probably Google just coming back to see if you have changed them. I think your site has a different update frequency for some pages as opposed to others.

This will let us know if the front pages get trawled more often than the pages in the deeper directories

[Charlie_D]

Hey guys

I'm glad that you find the tool useful.

bwelford

Interestingly I don't know why these four because they haven't changed in quite a while

I'm guessing that it has something to do with internal link structure.......Read on below

Yeah bwelford, I have had the same question with some of my pages,- and why some (older) pages were indexed as opposed to some newer updated pages with fresh content.

By using the tool over a period of time, and studying the results of what pages they are indexing, we can perhaps learn alot on exactly how google spiders and updates pages.

I think that sometimes they go into a deep crawl and sometimes (more commonly) they just update the top level domain. The tool doesn't seem to work with sub-domains. It only will give you results from your top level domain. Would've been cool though if you could check pages independently.

TIP 1

One thing I did notice using the tool though, which may be helpful for many of you, is that if you create a new page or update a page and you want google to index it quicker. Put a link to the new page on your homepage somewhere near the top of the page and google will usually find it on the next crawl or and update it for you.

TIP 2

Update pages frequently by adding fresh content. If you have some old pages stagnant and they aren't showing up in the serps. Update them with some fresh keywords within your page content and you may be surprised!

Even if your pages are doing well in the serps, Update them anyway. (be careful not to play around too much and lose a good position) but add some fresh info pertaining to what you already have and google will reward you. Google seems to put more weight on pages that are changing all the time. I guess there thinking is that the content is fresh and more relevant perhaps. You should do better over a long period of time.

Google seems to love fresh content and will update your site often If you give it some fresh content ( Give the google spiders some fresh food to eat )

[travis]

Mate,

No doubt, your an idea's man. Keep up the research and those fresh brain cells alive.

[Charlie_D]

Hi Travis

Thanks for the kind words mate. I appreciate it


Travis wrote

I noticed with my newest customer that the front page has been trawled, but nothing else. 

I think your site has a different update frequency for some pages as opposed to others. 

Yes. The home page seems to always get trawled more often than the pages in the deeper directories.

We need to figure out how to get those deeper pages updated frequently too. I think it definitely has to do with link structure.

If you put a link from your homepage (as mentioned in my other post) to the new page and also try to link to it from every page within the site I find that google will find it quickly.

Sometimes its just not possible to link to a deep page from every page, In that case, A site map is invaluable.


Charlie

[travis]

Mate,

You shouldn't have. Golden Secret Tips just for me.

I will give it a crack and see what happens. Generally speaking, our site trawling is OK. Getting my new clients frequency of updates to increase takes a while, so I will take your advice on board.

Be Good.