User-agent: * Disallow: /cgi-bin/ Disallow: /index.php5* Disallow: /ecos/ Disallow: /ECOS/ Disallow: /util/ Disallow: /en/s/ Disallow: /es/s/ Disallow: /de/s/ Disallow: /fr/s/ Disallow: /it/s/ Disallow: /nl/s/ Disallow: /en/c/ Disallow: /es/c/ Disallow: /de/c/ Disallow: /fr/c/ Disallow: /it/c/ Disallow: /nl/c/ Disallow: /en/secure/ Disallow: /es/secure/ Disallow: /de/secure/ Disallow: /fr/secure/ Disallow: /it/secure/ Disallow: /nl/secure/ Disallow: /en/mybooking/ Disallow: /es/mybooking/ Disallow: /de/mybooking/ Disallow: /fr/mybooking/ Disallow: /it/mybooking/ Disallow: /nl/mybooking/ Disallow: /webservices/ Disallow: /en/favourites/ Disallow: /es/favoritos/ Disallow: /fr/favoris/ Disallow: /de/favoriten/ Disallow: /it/preferiti/ Disallow: /nl/favoriten/ User-agent: Exabot Disallow: / User-agent: Ezooms Disallow: / User-agent: npbot Disallow: / User-agent: psbot Disallow: / User-agent: larbin Disallow: / User-agent: WebCopier Disallow: / User-agent: HTTrack Disallow: / User-agent: superbot Disallow: / User-agent: Gaisbot Disallow: / User-agent: HenryTheMiragoRobot Disallow: / User-agent: bumblebee@relevare.com Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: Zeus Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: turnitinbot Disallow: / User-agent: voyager/1.0 Disallow: / User-agent: MJ12bot/v1.0.7 (http://majestic12.co.uk/bot.php?+) [^] [^] Disallow: / User-agent: ASpider/0.09 Disallow: / User-agent: appie 1.1 (www.walhello.com) Disallow: / User-agent: Rogerbot Crawl-delay: 10 User-agent: slurp Crawl-delay: 5 User-Agent: AhrefsBot Crawl-Delay: 5 User-agent: Baiduspider Crawl-Delay: 5 User-agent: Baiduspider-image Crawl-Delay: 5 User-agent: Baiduspider-video Crawl-Delay: 5 User-agent: Baiduspider-news Crawl-Delay: 5 User-agent: Baiduspider-favo Crawl-Delay: 5 User-agent: Baiduspider-cpro Crawl-Delay: 5 User-agent: Baiduspider-ads Crawl-Delay: 5 User-agent: Baidu Crawl-Delay: 5