# /robots.txt file for http://spider.science.strath.ac.uk #User-agent: * #Disallow: / User-agent: DataCha0s Disallow: / User-agent: DataCha0s/2.0 Disallow: / User-agent: SemrushBot Disallow: / User-agent: * Disallow: /help/