The White House web site’s use of its robots.txt file to disable search engines from crawling certain material is an exercise in historical revisionism. Many excluded items in the robots.txt file involve mentions of Iraq, possibly to prevent people from finding changes to past statements and information when archived elsewhere
Share this Story