Thursday 12 May 2011

How To Tell when Google Crawled your Website

Google has spiders or Google Bots that crawl your website to update keywords and to index it in their site. This process lets your site be on top of the search list when someone types in the keywords in Google’s search box. The spiders and bots that Google uses to crawl websites do it on a regular basis. There are several factors that can affect a site’s crawl: its PageRank, the links to a specific web page and other parameters on the URL. Google’s crawl process is algorithmic, meaning it decides on which websites to crawl, how to often to crawl the site and how many pages to crawl from every site. If you have your own website and you want to know when Google last crawled your site, this article will show you how.

* Open searchenginegenie.com. It will direct you to its home page. Search Engine Genie is an SEO or Search Engine Optimization. This is where you can see the last date that the Google Bot has crawled your website. This site is very easy to use as you only have to click tabs in order to know when your site was last crawled.
* Choose the 100 Web Tools option. This is located at the top of the screen, together with other tabs. Point the mouse to the 100 Web Tools tab and click on the Google Tools option. A new window will appear and you can find the next step on the left side of the screen. Under Google Tools, look for and click the Google Bot Last Accessed Date tab.
* Enter your website’s URL. Once you have clicked the Google Bot Last Accessed Date tab, you can now type the URL. After typing your site’s address, you will solve a simple mathematical problem. Click the Submit button once you are done. Make sure that you put your website’s main address and not just a link to a page or pages within the site if you want to know when the Google Bot last crawled your entire website. But you can also do this if you want to check on a particular page. Type the link to that page on the address box and you will see the result. Do this on pages that you have recently updated to see if Google has already indexed and crawled that page. This will let you know if your updates have been checked.
* Check the date. A small box will appear above the box where you typed your domain name. This is where you will see when your website was last crawled by the Google Bot. This is what will appear on the box: Site URL: (your website) Result: Google last accessed your site on (the date).


To make the Google bots and spiders crawl your website as frequently as possible, make sure that you update your site and avoid unnecessary content that might affect your PageRank and crawling of your site. Spiders and bots do not crawl all the pages in a particular site. Google does not charge owners of websites a fee for crawling their sites. It is done for free.

No comments:

Post a Comment