[Xfce4-commits] <www:master> Stupid crawl bots.

Nick Schermer noreply at xfce.org
Sun Apr 1 15:06:01 CEST 2012


Updating branch refs/heads/master
         to 1f5aaf056a25df13839726c40c011d226483fc26 (commit)
       from ed8e7c38c1afa05e076a5c8016a09220d522c59f (commit)

commit 1f5aaf056a25df13839726c40c011d226483fc26
Author: Nick Schermer <nick at xfce.org>
Date:   Sun Apr 1 15:04:50 2012 +0200

    Stupid crawl bots.

 robots.txt |    1 +
 1 files changed, 1 insertions(+), 0 deletions(-)

diff --git a/robots.txt b/robots.txt
index 5d98e3d..d6d32fc 100644
--- a/robots.txt
+++ b/robots.txt
@@ -1,3 +1,4 @@
 User-agent: *
 Disallow: /images/
 Disallow: /style/
+Disallow: /archive/


More information about the Xfce4-commits mailing list