User-agent: *
Crawl-Delay: 30
Allow: /