Nothing in index after 2007; ia archiver hits robots.txt only, but we don t exclude ia archiver bot.

There's nothing in the archive after 2007 for [URL] though the archive.org bot is hitting robots.txt (and only robots.txt) daily. 207.241.227.75 - - [18/Dec/2010:17:58:43 -0800] "GET /robots.txt HTT...

Posted by: Exodus Development, Inc.