# # # Oh hai! # # # # Not relevant to major search spiders # User-agent: * Disallow: /like/ Disallow: /user/ # # The 'grub' distributed client has been *very* poorly behaved. # User-agent: grub-client Disallow: / # A capture bot, downloads gazillions of pages with no public benefit # http://www.webreaper.net/ User-agent: WebReaper Disallow: /