Track Googlebot in Google Sitemap (Webmaster Tools)

Today, Google added a new cool feature to their Webmaster Tools (Google Sitemap) which gives you enhanced reports for Googlebot Crawl. This includes Reports for, Number of Pages Crawled per Day, Number of Kilobytes Downloaded per Day and Average Time Spend for Downloading a Page.

Where you can see Googlebot Crawl Reports?

Login to your Webmaster Tool Center (google sitemap) and under the Diagnostic Tab in the Left-hand side Menu you can see a new Option added as ‘Crawl Rate’. Clicking on this link you will get the above mentioned Googlebot Reports for the past 90 Days of time.

Want to Slow Down the Googlebot Crawl Rate?

One Cool option is available along with these Crawl Reports, now you can tell Google to Slow down the GoogleBot Crawl rate if your site is experiencing an abnormal fast rate. We all know this was an issue for some Webmasters that GoogleBot is crawling their site too much fast and eating the bandwidth a lot. Now in such situations, you can just tell them to Slow down the GoogleBot crawl speed by checking the ‘Slower’ radio button option and say ‘Save’.

Some more Additional Options are available:

  • Enhanced image search: This enables enhanced Image searches in your websites, including advanced Image Labeling techniques for Images hosted by Google. If you choose to enable enhanced image search, Google will use tools such as Google Image Labeler to associate the images included in your site with labels that will improve indexing and search quality of those images. This option is also available under the ‘Diagnostic’ Tab.
  • Number of URLs submitted: This is a new addition to the Sitemap Reports, under the Sitemap tab now you can view the ‘Number of URLs Submitted’, along with the Submitted, Last Downloaded dates and more. This is also a nice option which makes you comfort if you are using Automated Tools to generate the Sitemap.xml. You can now compare this Number of URLs Submitted along with your Number of Pages to make sure the integrity.

A Word from the Author:

Today is a happy day for me, now I can test some more reports and am sure these are good ones to add to the routine check-lists. Previously for the Googlebot reports I had to run the ClickTracks – even though it gives me some more enhanced reports about Bots – after downloading the Logs and importing into the tool. Now I can save some time and the basic reports are now Free and are just a few clicks away.

kichus

I'm Navaneeth Kishor aka kichus - an Adwords professional and SEO Consultant from India. Owner of VirtueSEO search marketing, serving the industry from past 6 years.

Leave a Reply

You must be logged in to post a comment.