WebmasterWorld Out Of Google & MSN

[Krumel]

WebmasterWorld Out Of Google & MSN

A search today for the same thing doesn't bring up the site at all. Yes, WebmasterWorld banned Google from spidering it. However, that doesn't prevent Google from listing at least the home page by making use of the Open Directory information, which doesn't require spidering the WebmasterWorld web site.

Modificat: Blink And It’s Gone

lets try this for a month or three… says Brett Tabke, owner of WebmasterWorld.com.

I just finished reading a fun post by my buddy WebGuerrilla (that’s the terrorist not the monkey to you n00bs and it’s 2 r’s and 2 l’s for those of you that have spell check turned off…) and figured this is newsworthy so I’d get on the bandwagon.

[Krumel]

Brett Tabke Interviewed on Bot Banning

Brett Tabke, owner of WebmasterWorld, has given me the privilege to ask him a bunch of questions on the recent news that WebmasterWorld Bans Search Engine Bots from Crawling. So here it is....

Barry: Brett...Thank you for taking the time during this hectic period at WebmasterWorld to answer several questions about the recent changes you have made, to disallow spiders from accessing your site.

Barry: The big change was that you, on November 18th, changed your robots.txt file to disallow all bots from accessing your Web site. In a thread you started in the Foo forum at WebmasterWorld named lets try this for a month or three... you elegantly linked to your robots.txt file to show people. And subtitled the thread, "last recourse against rogue bots." Why was this the last course of action? I have spoken with dozen of site owners who run sites as large as yours. Most tell me that you can fight off these rogue bots one by one, but you need to factor in the costs of these bots into your hosting prices. How would you respond to that?............

Discutia mi se pare destul de interesanta. Ca si ideea lui Brett Tabke dealtfel.