User-agent: * Disallow: /package/rate/ <<<<<<< /home/okfn/var/srvc/de.ckan.net/pyenv/src/ckan/ckan/public/robots.txt User-Agent: * Crawl-Delay: 5 ======= User-Agent: * Crawl-Delay: 10 >>>>>>> /tmp/robots.txt~other.sClRZo