Re: Why does the wayback machine pay attention to robots.txt

As far as I know, yes you will be able to, however there isn't a guarantee that the wayback machine will have grabbed the pages you are looking for. You could also look on http://archive.is/ to see if...

Posted by: hook54321a