Talk:Static dumps

static.wikipedia.org being crawled and indexed by google

I see that static.wikipedia.org appears on google searches like this one. I see that on the site's robots.txt file they have disallowed "/wikipedia/", but now that directory does not exist, and the wikipedia directory exists also on a root folder called "new", so google is probably crawling all of "/new/wikipedia/" which probably means millions of files. Can someone update the robots.txt file to disallow "/new/wikipedia/"? copied from discusion on enwiki's village pump --Enric Naval (talk) 00:27, 22 June 2008 (UTC)