X-Git-Url: http://git.cyclocoop.org/?p=lhc%2Fweb%2Fwww.git;a=blobdiff_plain;f=www%2Fsquelettes-dist%2Frobots.txt.html;fp=www%2Fsquelettes-dist%2Frobots.txt.html;h=d91f9c08224e77df1c23a0e359cfbed574cfca9f;hp=e45138b89d5703f3f1761f4d1737d7d4a3b89324;hb=122c920eb07e3f665789f8734965b576e6c25515;hpb=226942065cd4f604eb464addf45a065c9e5bc916 diff --git a/www/squelettes-dist/robots.txt.html b/www/squelettes-dist/robots.txt.html index e45138b8..d91f9c08 100644 --- a/www/squelettes-dist/robots.txt.html +++ b/www/squelettes-dist/robots.txt.html @@ -16,3 +16,6 @@ Disallow: /squelettes-dist/ Disallow: /squelettes/ Sitemap: #URL_SITE_SPIP/sitemap.xml + +User-agent: * +Crawl-delay: 1 \ No newline at end of file