robots.txt

How can allow Internet Archive sub domains while at the same time have it exclude from any search engine, like Google, Yahoo example, using the www.yourdomain.com/robots.txt

Posted by: flippertv