SEO Files > [SMM] Search Engine Optimization, Montreal, 2005 - SEO In The Here And Now

[BPWrap - Internet Marketing From A Different Point Of View] All search engines have Terms of Service, which specify what websites they will index in their databases. In summary, these TOS's require that the web pages presented to their spiders or robots are exactly those seen by their human visitors. The search engine robots are constantly surfing the Internet, following links from one web page to another, and cataloguing the content of these web pages. By clever programming, it is possible to show a different web page to the robot than is seen by a human visitor.

Some slightly related from Technorati and Google.

http://tools.devshed.com [Tools.devshed.com] Webmaster Tools, Developer Tools, Programming Tools - Dev Mechanic: There is no doubt that reprint articles can serve lots of search engine traffic to your site... All you have to do is to check your traffic logs and you will see how much traffic finds your site via one of the major search engines, as a result of those reprint articles being located on your website.  More | Discuss

Metamend.comhttp://www.metamend.com [Metamend.com] Search Engine Spiders and Robots - Metamend: Unfortunately, the tools that the search engines depend upon to add content to their databases are neither cutting edge nor are they incredibly powerful. Search engine robots have very limited functionality, similar in power to that of early web browsers in terms of what they can understand in a web page. From the information that is visible to them, these spiders grab information like page titles, meta tags and meta data, and textual content to be included in the search engine's index or database.

Tnl.nethttp://www.tnl.net [Tnl.net] Google Accelerates Search: The way those indexes are created is through programs that are known as spiders (sometimes also referred to as web-robots or crawlers). Those programs are independent pieces of software that go and basically surf the web at very high speed, making copies of everything they encounter and comparing what they find to what other spiders are found. That giant set of pages copied by spiders is called an index (it is also sometimes referred to as a collection). They run around the clock and their sole job is to get more pages and ensure that the pages they've gotten in the past still exist and that they have not changed (if they have changed, the spider will "re-index" the page, ie.

[Ysearchblog.com] Yahoo! Search blog: Yahoo! Search Tips for Webmasters: Saving ...: Crawl-Delay: There's one last trick you can use to help reduce the bandwidth requirements of your site. You can use a special robots.txt directive, crawl-delay, to reduce the speed at which our crawlers make requests to your site. This allows webmasters to manage their bandwidth without restricting content on their site from crawlers and is being used effectively by sites like Slashdot. A safe value for this would be a delay that would allow us to fetch every page on your site in about five days.

Eff.orghttp://www.eff.org [Eff.org] EFF:: If you are worried that your blog-hosting service may be logging yourunique IP address and thus tracking what computer you're blogging from,you can use the anonymous networkTor to edit your blog. Tor routes yourInternet traffic through what's called an "overlay network" that hidesyour IP address. More importantly, Tor makes it difficult for snoops onthe Internet to follow the path your data takes and trace it back toyou.

Reflected tags on Technorati: Blog, , , , , ,