Quote:
Originally Posted by schettj
And as a webmaster, I'd be banning that bot as soon as I detected its footprint in my logs  Unless bandwidth is free, repeatedly hammering a page to check for diffs is pretty useless.
Just check back in march to see if they've finally released the Late January update... |
Well, I don't think it checks the site that often. I assumed it was more like the way a search engine crawls the web. I know its not really that useful. I can just check the site myself every day if I wanted to. The thought just came to me, and I was kinda bored at work. Man, cynical crowd : )