Re: Why does the wayback machine pay attention to robots.txt

Hi, I'm a novice here, I am currently involved in a court case and I could really do with access to a particular website using the internet archive but the robots.txt problem has now stopped me acce...

Posted by: peterdaly