Trying to let the crawler access a site but won t let me see the archives.

The IA crawler has been blocked on tfwiki.net for a while now, but last week I unblocked it in the site's robots.txt. You can see the full robots.txt here: http://tfwiki.net/robots.txt This seems to. ..

Posted by: abates