# robots.txt --- Robert Hallatt 2006-05-09 # disallow intrastructure directories for all robots User-agent: * Disallow: /includes/ Disallow: /Connections/ Disallow: /images/ Disallow: /site-admin/ Disallow: /forum-2007/ Disallow: /sphider/ Disallow: /login.php Disallow: /forgot_password.php Disallow: /printable.php Disallow: /comments/