# robots.txt # maintained by NetCologne GmbH # U.Babiak 7/2001 # indexing and spidering OK within reasonable limits # abuse will be prosecuted # now start working! # if using htdig, everything is fine (htdig_noindex markers # in place to prevent loops ) # other agents: avoid endless loops inside news area # robots ignoring this directive will be banned User-agent: Mediapartners-Google* Disallow: /forum Disallow: /go User-agent: * Disallow: /news/ Disallow: /forum/ Disallow: /szene/kino/