# All robots will spider the domain User-agent: * Disallow: /Merchant2/ Disallow: /mm5/ Disallow: /http://www.stop-crime.com/page/OSP/PROD/M1H Disallow: /http://www.stop-crime.com/page/OSP/PROD/M1D Disallow: /http://stop-crime.com/page/OSP/Security-Selection User-agent: Titan Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: /