Re: robots.txt only gives temporary removal of pages?

In fact you can exclude just our spider. We have two that you should exclude in your. txt file. They are ia archiver and ia archiver2 If you have any other questions, please let me know.

Posted by: PaulForrest