# robots.txt file for www.ma.hw.ac.uk # this files tells automated search robots which directories # they shouldn't try to index (if they're well behaved) # This is aimed at all search agents: User-agent: * Disallow: /cgi-bin/ Disallow: /localsoft/ Disallow: /systemdocs/ Disallow: /matlab/ Disallow: /~steve/brief_guide Disallow: /images/