# robots.txt DNRC User-Agent: * Disallow: /favicon.ico Disallow: /images Disallow: /images/* Disallow: /images/* Disallow: /divisions/water/water-rights/docs/forms/wr_forms.asp Disallow: /divisions/water/operations/docs/dam-safety/technical-references/procedure_determining_spillway_adequacy.pdf User-agent: TurnitinBot Disallow: / User-agent: RU_Bot Disallow: / User-agent: larbin Disallow: / User-agent: Yandex Disallow: / User-agent: Baidu Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: Bingbot Crawl-delay: 10 Disallow: User-agent: MSNbot Disallow: User-agent: archive.org_bot Allow: / User-agent: * Visit-time: 0600-1200 # only visit between 06:00 (6AM) and 12:00 (12PM) UTC (GMT)