# Robots.txt -- Prevent ALL search engines from crawling # Robot Exclusion File -- robots.txt # Author: Michael Link # Last Updated : January, 6 2010 #To prevent all bots from any scans User-agent: * Disallow: / #To prevent any images from being scanned #Disallow: *.gif #Disallow: *.jpg #Disallow: *.png #To block main page due to size from bots #Disallow: /index.php #To shut down site completely from bots use #Disallow: /