User-agent: Mediapartners-Google* Disallow: /Zusatzdienste/Urteilsfenster/Urteilsfenster.php User-agent: MJ12bot Disallow: / User-agent: * Disallow: User-agent: MSIECrawler Disallow: / User-agent: psbot Disallow: / User-agent: Fasterfox Disallow: / User-agent: Slurp Crawl-delay: 800