# robots.txt file to allow any search engine # robot (spiders) to search this web site User-agent: * # Specifies all robots Disallow: # Disallow nothing (ie allow everything)