# Put this file in the root directory of the webserver, # e.g. http://pem.ncspearson.com/robots.txt # Exclude Files From All Robots: User-agent: * Disallow: / # End robots.txt file