Crawl-delay: 600          # delay between requests
Visit-time: 2000-0400    # hours to allow crawling
Request-rate: 1/30       # how many requests/seconds</body>