# robots text. User-agent: Slurp Crawl-delay: 1000 User-agent: * Disallow: /edit/