User-Agent: *
Disallow: /streamrotator/
Disallow: /linkex/
Disallow: /progress/
Disallow: /archive.html