User-agent: Slurp Disallow: /business/boardrecordings/ Crawl-delay: 100 User-agent: * Crawl-delay: 100