SEO Files > WebmasterWorld Dropped from Google Due to Robots.txt

Social Patterns - Michael Nguyen on Search Engine Marketing[ Social Patterns - Michael Nguyen on Search Engine Marketing] It didn’t take long for Google and MSN to drop WebmasterWorld completely from their indexes after Brett Tabke changed WebmasterWorld’s robots.txt to disallow all spiders. WebmasterWorld is not showing up in Google or MSN and I’m sure Yahoo is soon to follow.

Some related posts from Technorati and Google.

Jaan Kanellis SEO Blog: In a bold and very interesting move, Webmaster World’s, Brett Tabke has completed its filter of all robots (good and bad) from visiting there website. Do a search on any of the major search engines and you will see no WW results what-so-ever. (via Cosmos)

tony spencer - aka notsleepy tony spencer - aka notsleepy: When Brett Tabke decided to disallow all search engine bots via robots.txt on Webmasterworld, I was amazed to hear that his reasoning was that rogue bots check the robots.txt and thus by disallowing them they would go away. That hasn't been my experience on any of my sites. (via Cosmos)

SEO Black Hat: Black Hat SEO Bloghttp://seoblackhat.com  SEO Black Hat: Black Hat SEO Blog: Webmasterworld now requires cookies and has taken some other anti-bot measures, and they felt that cloaking for Google to allow continued spidering by G-bot would not be in compliance with Google’s quality guidelines. Hence, the complete exclusion of bots, good and bad. (via Cosmos)

http://www.oilman.ca/blog  Oilman: I just finished reading a fun post by my buddy WebGuerrilla (that’s the terrorist not the monkey to you n00bs and it’s 2 r’s and 2 l’s for those of you that have spell check turned off…) and figured this is newsworthy so I’d get on the bandwagon. (via Cosmos)

[ - rogerd’s notebook] WebmasterWorld: Community vs. Bots, Part 2: (While even this step wouldn’t eliminate all unwanted spiders, it would cut out most of the less sophisticated bots.) The robots.txt ban reflects not so much that “legitimate” bots (like spiders from Google, Yahoo, and MSN) were causing a problem as that allowing these bots to navigate the site with impunity while requiring human visitors to log in would probably not comply with search engine quality guidelines.

Blog.searchenginewatch.comhttp://blog.searchenginewatch.com [Blog.searchenginewatch.com] WebmasterWorld Out Of Google & MSN: Todd Freisen describes the system more in Blink And It’s Gone, and he's at least one person who submitted the new WebmasterWorld robots.txt file to speed up the removal process. Todd's also been tracking page counts for the site in various search engines:WebmasterWorld Index Watch 3, WebmasterWorld Index Watch 2 andWebmasterWorld Index Watch.

Seroundtable.comhttp://www.seroundtable.com [Seroundtable.com] Search Engine Roundtable ::: The Pulse Of The Search Marketing ...: Shawn puts WebmasterWorld "at loosing 500,000-1M unique visitors per month." He continues to explain, that if you look at Alexa Reach Per Million for WebmasterWorld, you will notice that they went from 2,190 to 1,050, about half of their traffic.

Reflected tags on Technorati: Blog, ,