# robots.txt for http://www.trct.co.uk # v1.0 May 2006 - Tony Collings # v2.0 Jan 2007 - Tony Collings # http://www.robotstxt.org/wc/robots.html # Allow all the following agents User-agent: * Disallow: # Ban Inkotomi_Slurp User-agent: Slurp.so/1.0 User-agent: Slurp/2.0j User-agent: Slurp/2.0-KiteHourly User-agent: Slurp/2.0-OwlWeekly User-agent: Slurp/3.0-AU Disallow: / # Dont' crawl these directories User-agent: * Disallow: /blog/wp-admin/ Disallow: /catalog/admin/