# Begin robots.txt file User-agent: * Disallow: /images/ User-agent: Googlebot User-agent: GSiteCrawler User-agent: Inktomi Slurp User-agent: Jeeves User-agent: Lycos User-agent: Lycos_Spider_(T-Rex) User-agent: Mediapartners-Google* User-agent: MSIECrawler User-agent: MSNBot User-agent: MSNBOT/0.1 User-agent: Slurp User-agent: Slurp/2.0-KiteHourly User-agent: Slurp/2.0-OwlWeekly User-agent: Slurp/3.0-AU User-agent: Yahoo! Slurp User-agent: Yahoo-MMCrawler Disallow: User-agent: * Disallow: / # End of robots.txt file