# author: csimmons # created: 10/10/2007 # lastupdated: 11/30/2014 # purpose: secure site from bots, etc. User-agent: * Crawl-delay: 10 User-agent: * #Directories Disallow: /apps/ Disallow: /aref/csc/research_regulatory_binder Disallow: /arefcfcs/ Disallow: /arefcommunications/ Disallow: /arefdocs/ADP/ Disallow: /arefdocs/forms/aref_forms/AFLAC Disallow: /areftags/ Disallow: /arefwebservices/ Disallow: /dev/ Disallow: /guardpage/ Disallow: /arefdocs/vmu_policies/ Disallow: /MMWIP/ Disallow: /PA/ Disallow: /rest/ Disallow: /scheduled/ Disallow: /Scripts/ Disallow: /Templates/ Disallow: /udfs/ Disallow: /utilities_secure/ #Individual Files Disallow: /alive.cfm Disallow: /font-size-set.cfm Disallow: /common/newsdetail.cfm