Como Mantener A Raya A Los Bots
Publicado: 28 Mar 2007, 14:44
si bien estan en inlges creo que pueden ser utiles
How To Keep Bad Robots, Spiders And Web Crawlers Away
Table of contents
* Trapped and/or Banned Robots
* Definition of a bad robot
* How to identify bad robots
* Banning bad robots from the site
* The Robot Trap
* Download the traps
Some of those robots are welcome, others are not. This page will show you how I catch the bad ones, and how I stop them from bothering me again.
http://www.fleiner.com/bots/
http://danzcontrib2.free.fr/en/pieges.php
How To Keep Bad Robots, Spiders And Web Crawlers Away
Table of contents
* Trapped and/or Banned Robots
* Definition of a bad robot
* How to identify bad robots
* Banning bad robots from the site
* The Robot Trap
* Download the traps
Some of those robots are welcome, others are not. This page will show you how I catch the bad ones, and how I stop them from bothering me again.
http://www.fleiner.com/bots/
http://danzcontrib2.free.fr/en/pieges.php