Re: Why does the wayback machine pay attention to robots.txt

Yes. I'm trying to ask a webmaster to unblock the internet archive, but there is no archive.org link I can point him to that will explain how he can do so. Why in the world does http://archive.org/ab...

Posted by: archivefcc