User-agent: * Disallow: /search/ # block bots from indexing search results pages User-agent: twiceler Disallow: /forums/ User-agent: libwww-perl/5.801 Disallow: /forums/ User-agent: libwww-perl/5.803 Disallow: /forums/ User-agent: libwww-perl/5.808 Disallow: /forums/ User-agent: libwww-perl/5.79 Disallow: /forums/ User-agent: Slurp Disallow: /forums/ User-agent: msnbot Disallow: /forums/ User-agent: Y!J-BRO Disallow: /forums/