I talked about this a while back: https://news.ycombinator.com/item?id=6572937
Someone decided to ban all bots from accessing their site except for Google and Bing. So much for "if you're so worried about Google just use another search engine".
I talked about this a while back: https://news.ycombinator.com/item?id=6572937
Someone decided to ban all bots from accessing their site except for Google and Bing. So much for "if you're so worried about Google just use another search engine".