# robots.txt of topfit24.com # Mainly to stop the search engines crawling pages in the forum it doesn\'t need to. User-agent: * Disallow: /banner/ Disallow: /farben/ Disallow: /font/ Disallow: /help/ Disallow: /img/ Disallow: /pic/ Disallow: /v/ Allow: /article/ #crawl-delay: 5 #Despictable and evil robots to keep out :) User-agent: WebZip Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: WebBandit Disallow: / User-agent: EmailWolf Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: SiteSnagger Disallow: / User-agent: Website Quester Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: spanner Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: Web Image Collector Disallow: /