Re: Certain URLs crashing wayback interface?

I have always thought that robots.txt is not the best way to check if a website has to be removed from the archive. Instead, perhaps the requests should be made *in the files itself*, to circumvent th...

Posted by: Face