The country’s new robots.txt file
Here’s a small and nerdy measure of the huge change in the executive branch of the US government today. Here’s the robots.txt file from whitehouse.gov yesterday:
And it goes on like that for almost 2400 lines! Here’s the new Obamafied robots.txt file:
That’s it! BTW, the robots.txt file tells search engines what to include and not include in their indexes.
Is this just accidental or temporary, or a real and sustainable effort at improving access to government information? We shall see.