Re: Why does the wayback machine pay attention to robots.txt

I'm glad to see this discussion is on-going. I'm going to create some scripter to replace my archive look-ups with that little trick, so I can access those records with a click if I come across them. ...

Posted by: d0c5i5