If you want to know the instant Google’s bot visits your site then you’re a severe algoholic. And Crawler alert will help you get your fix. Crawler alert will send you an email when any of the major search bots visit the page you specify.
Discuss other Google Alerts in WebProWorld.
You will have to place a file on your site along with a link to this file on your front page. When crawlers roll through your site they call up the content from the file and the Crawler Alert server checks the crawler signature and compares it to the crawlers for which you wanted notification.
The crawlers it checks for includes the biggies like GoogleBot and Slurp on to the lesser known bots like KIT_Fireball by Fireball, and NetScoop by NetScoop.
The creators of the service run a SEO firm in Israel and received regular requests from their clients with new content who wanted to know if they had been crawled yet. In their words, “we decided that it could really be a useful tool for every web site owner or a web design/search engine optimization (SEO) firm that works with customers, so we opened it for the general public.”
If you’d prefer not to dig around in your log files, or if you’re too busy to monitor them, the Crawler Alert service might be for you.
I didn’t investigate the file they have you put on your server though, or any possible link benefit they may receive from having the file pointing to their server.
Their privacy policy states, “the information you provide Crawler Alert will be used only to provide you the Crawler Alert service.” I haven’t seen any of these alerts – there may be some advertising for the Crawler Alert
creators.
If you’d like to try it out visit Crawler Alert.
Garrett French is the editor of Murdok’s eBusiness channel. You can talk to him directly at WebProWorld, the eBusiness Community Forum.
