From: Michal Vaner Date: Tue, 15 Jul 2008 08:34:01 +0000 (+0200) Subject: Forbid search spiders looking into changing forms X-Git-Url: http://mj.ucw.cz/gitweb/?a=commitdiff_plain;h=248beeac2891cb4e15bee8ac7ccdee46460609f7;p=pciids.git Forbid search spiders looking into changing forms --- diff --git a/robots.txt b/robots.txt new file mode 100644 index 0000000..3ccee7d --- /dev/null +++ b/robots.txt @@ -0,0 +1,2 @@ +User-agent: * +Disallow: /mods/