# Robots.txt file from http://www.ctoof.net/# All robots will spider the domainUser-agent: * Disallow: /wp- Disallow: /feed/ Disallow: /comments/feed Disallow: /trackback/