# Google will direkt angesprochen werden. User-agent: Googlebot Crawl-Delay: 30 Disallow: /cgi-bin/ Disallow: /vv=sendungswecker/ Disallow: /pv=print/ Disallow: /pv=mplayer/ Disallow: /vv=pdf/ Disallow: /cf=42/ Disallow: /export/ Disallow: /pv=plain/ Disallow: /pv=email/ Disallow: /index.jpg Disallow: /index.gif Disallow: /index.css Disallow: /index.js Disallow: /index.zip # Feed Allow: /export/rss/ User-agent: Googlebot-Image Disallow: / # AltaVista's Photo Finder User-agent: vscooter Disallow: / User-agent: ia_archiver Disallow: / User-agent: Teleport* Disallow: / User-agent: Webwhacker* Disallow: / User-agent: Webzip* Disallow: / User-agent: Net Attache* Disallow: / User-agent: SiteSnagger* Disallow: / User-agent: HTTrack* Disallow: / User-agent: WebCapture* Disallow: / User-agent: WebSauger* Disallow: / User-agent: yacybot Disallow: / User-agent: Googlebot Disallow: /*sid=* Disallow: /*session* Disallow: /swr2/programm/sendungen/leben/rueckschau/-/id=660144/nid=660144/did=1757054/xbewx5/index.html Disallow: /swr2/programm/sendungen/leben/rueckschau/-/id=660144/nid=660144/did=1754426/1kugbu8/index.html Disallow: http://www.swr.de/swr2/programm/sendungen/leben/rueckschau/-/id=660144/nid=660144/did=1754828/9i7no3/index.html User-agent: * Crawl-Delay: 30 Disallow: /cgi-bin/ Disallow: /vv=sendungswecker/ Disallow: /pv=print/ Disallow: /pv=mplayer/ Disallow: /vv=pdf/ Disallow: /cf=42/ Disallow: /export/ Disallow: /pv=plain/ Disallow: /pv=email/ Disallow: /index.jpg Disallow: /index.gif Disallow: /index.css Disallow: /index.js Disallow: /index.zip User-agent: swr-gsa-crawler Crawl-Delay: 30 Allow: /pv=mplayer/