# This robots.txt file tells ALL search engines, webcrawlers, spiders, robots, etc. # to NOT index the directories listed. Most major search engines respect this directive. User-agent: * # Directories that contain large numbers of graphics Disallow: /images/ # Directories that contain files related to programming or scripting Disallow: /Includes/ Disallow: /cgi/ Disallow: /library/ Disallow: /templates/ Disallow: /ariel/