Re: Robots.txt Abuses Defeating the Archive s Intent

Should we shred all the old newspapers and take magnets to any cassette recordings off of the radio that have commericals in between them as well? How about those old VCR recordings of TV with commerc...

Posted by: Telephone Toughguy