#robots.txt for http://www.spie.org/ User-agent: * Crawl-delay: 10 Sitemap: http://spie.org/sitemap.xml Disallow: /app/ Disallow: /app/optin/ Disallow: /Documents/BCMT/ Disallow: /Documents/HumanResources/RandyC/ Disallow: /documents/Newsroom/Imported/ Disallow: /app/search/ Disallow: /app/submissions/ Disallow: /shoppingcart Disallow: /StudentChapterReports/Tokushima_Report_201507.pdf Disallow: /delivery/ Allow: /app/program/ Allow: /app/exhibitor/ Allow: /app/exhibitordirectory/ Allow: /app/registration/ Allow: /app/schedules/ Allow: /app/profiles/