Requests for dumps

2008-02-14T00:54:52Z

4.244.144.29:

{{process header
| title = Requests for dumps
| section =
| previous = ← [[WM:I/RP|Requests and proposals]]
| next = [[/Archives|Archives]] →
| shortcut =
| notes = Ask on this page for dumps that you need but that are not available from [http://download.wikimedia.org/ download.wikimedia.org], or that you cannot reasonably download from that site because of bandwidth limitations (on your end or on [[Wikimedia]]'s end). Please specify which wikis you want dumps for and what data you want in the dump. If you want dumps shipped to you on some type of media, please note the kind of media, and provide a way for someone to get in touch with you to coordinate shipping (you will have to pay for materials and shipping).

If you want an unusual set of data in a dump, please provide the query necessary to complete your request - it'll be slower if the developer concerned has to write the query.
}}

== Dump of English Wikipedia ==

I was wondering if anyone would be able to provide the following download on a DVD? pages-articles.xml.bz2 3.2 GB

Of course, I'm willing to pay for the postage, media and handling. Contact me at kwhartmaNOSPAM@artsci.wustl.edu. I'm on Wikipedia as OglaHai as well.

Thanks. [[Special:Contributions/4.244.144.29|4.244.144.29]] 00:54, 14 February 2008 (UTC)

== Dump of DEWIKI==
I wanted to install the german wikipedia with all its contents like pics, the full history and discussion etc. but then I saw, that the actual Dump is aborted and an older Version is not available.
Please make a new Dump of DEWIKI.

== Dump of wikiprotein.org ==
Please make a dump of wikiprotein.org. unsigned comment from 155.250.129.24
:Hi,
:wikiprotein.org isn't a wikimedia project.
:Try to see on this wiki the best contact or mail omegawiki <at> gmail.com.
:--[[User:Dereckson|Dereckson]] 15:58, 10 December 2007 (UTC)

== Dump of ru.wikipedia.org images ==

Please make a dump (if possible split into parts less than 300M) of the images (actual images, not just their descriptions) used by ru.wikipedia.org. This is needed for several wiki-projects in Russian.

Thanks!

== Dump For Wiktionary ==

Is it possible to have a dump for just page content and meta tags
To clarify:
I want is the an mysql or xml dump with just page
content with meta tags. I want to be able to add to those meta tags. It
shouldn't have anything else.

Thanks

==Dump of WikiSpecies==
I'm interested in getting a dump of species with taxonomic and vernacular names; is there any way to cross-reference with wikipedia articles on specific species? I'd really like to have the conservation status of each, but that doesn't seem to appear in WikiSpecies.

==Dump of Romanian Wikipedia articles==
I am an Natural Language Processing researcher, and need to have access to a dump of Romanian Wikipedia. I would prefer to have only the political articles, however the entire set of Romanian articles will do as well. The last dump that was performed had 25 errors, and the file pages-articles.xml.bz2 was not created. I would greatly appreciate your support. 11:00, 16 February 2006

== Full history dump of all languages (from late 2006) ==
Full-history dumps of all languages are large. Some are too large for the dumps to complete successfully. The last full-history dump of en:wp that works at the moment is from mid-August (another is underway; let's hope this one completes without trouble...) I would like a copy of the latest full-history dump of each language of each project on a hard disk; along with a summary list of the dates of each dump. If you have such data (dates don't have to be the same for each dump) and want to help, let me know; and I will send you a drive and return packaging. See also below. [[User:Sj|+sj]] | [[Babylon|help with translation]] |[[User Talk:Sj|+]] 03:37, 1 November 2006 (UTC)

Indeed; there is no working pages-meta-history.xml.bz2 in either of the dates available: one failed, one is still in progress. I suggest that the dumping system be improved to not delete a completed dump until a new, successful dump exists to take its place, to prevent this situation happening.--[[User:152.78.61.53|152.78.61.53]] 10:32, 2 May 2007 (UTC)

== Image dumps (from November 2005) ==
I would like image dumps with metadata; for instance the [http://downloads.wikimedia.org/images Wikimedia image dumps] from November 2005 from each project and from [http://download.wikimedia.org/images/special/commons/ commons]. More recent dumps would be excellent; but I don't know that any have been made.

The commons dump alone is 290GB. It will be cheaper and faster, and less strain on the dumps server, for me to ship a 500G disk to someone who could copy the dump. If you have access to a dump and could make me a copy, please get in touch by email to work out the details. [[User:Sj|+sj]] | [[Babylon|help with translation]] |[[User Talk:Sj|+]] 03:20, 1 November 2006 (UTC)

== Make random-subset dumps available from downloads.wikimedia ==

Many researchers just want a randomized subset of articles, or users, or revisions to run tests and experiments and programs on. At the moment, they either have to screenscrape what they want, or download the entire dump of the project they are interested in -- for en:wp, this is difficult to do regularly or efficiently.

Please consider adding subsets of en:wp and other wikis to the default collection of dumps: for instance, all revisions and users and metadata associated with 1000 random articles; or all metadata and revisions of articles touched by 1000 random users, along with their userspace pages. Here randomness could mean almost-even distribution across the set of all users with at least one edit, or articles that are not blank or redirects. Deciding how to randomize and what to select is not trivial; if you are interested in doing this, please ping the wiki-research-l list for more specific details on what good random subsets would include. [[User:Sj|+sj]] | [[Babylon|help with translation]] |[[User Talk:Sj|+]]

== Latest enwiki dump for which pagelinks.sql.gz got successfully generated ==

Hi, I've been looking for the latest enwiki dump that has page-to-page link records, but I couldn't find any at http://download.wikimedia.org/enwiki/ (every dump shows "failed" status for it). Where can I find such an instance?

:I'm looking for the same thing - could anyone point me to it? [[User:Martinp23|Mart]][[User_talk:Martinp23|inp23]] 17:16, 14 May 2007 (UTC)

== Full-history articles-only dump ==

It would be useful for research purposes to have a dump of all the ''content'' pages with full history, but not all the 'fluff' such as talk and user pages. This would fit a middle-ground between the current-version-only dumps, and the history-of-everthing gargantuan dump.--[[User:152.78.61.53|152.78.61.53]] 10:33, 2 May 2007 (UTC)

== Regular Wikipedia xml dump seems to be corrupted ==

I have been trying to download pages-articles.xml.bz2 and it downloads a file of about 700b of size (<1k). bz2 says this is corrupted . Would it be possible to redump or point to an older but working version of the xml dump? There is currently no version available.
:Are you downloading this file [http://download.wikimedia.org/enwiki/latest/enwiki-latest-pages-articles.xml.bz2-rss.xml]? You're probably looking for this one [http://download.wikimedia.org/enwiki/20070402/enwiki-20070402-pages-articles.xml.bz2]. --[[User:69.91.62.221|69.91.62.221]] 22:19, 20 May 2007 (UTC)

== Dump schedule ==

Is there any way to know what's in the queue to be dumped? The status page at [http://download.wikimedia.org/backup-index.html http://download.wikimedia.org/backup-index.html] is useful for knowing what's currently being dumped and what was recently dumped, but doesn't let us know what's coming up. Adding that information, as well as some historic dump dates, would let us estimate when any particular dump will be available.

I realize this isn't exactly a dump request, but this was the closest page I could find to ask this, and I figured that the people who have to fulfill dump requests would probably be interested in preventing at least some pointless requests by letting would-be requestors know that their favorite dump file is already scheduled to be generated later that day (and more importantly, would know how to output the queue that the dumper is using).

:Oh, and after watching the page for a while, I now see that it's just a big loop. It should probably say that somewhere.

== English Wikipedia Dump of July 16 ==
I am unable to understand how the English Wikipedia dump of July 16 : [http://download.wikimedia.org/enwiki/20070716/] has the page-meta-history.xml.bz2 file of just 5 GB. I remember the version previous to this one had a page edit history file in .bz2(and was named complete-page-edit-history.xml.bz2) format of size 85 GB. So, does the new meta file contain something other than complete page edit history?

== Help dumps ==

I must not be the first to ask about dumping specific help/editing/meta pages. I would really like it if it were possible to download these pages, and to reuse them in a wiki I'm setting up for my company, instead of writing my own help pages.

== All available enwiki dumps failed to dump pages and their histories ==

The two dumps currently available: [http://download.wikimedia.org/enwiki/20070908/ 2007-09-08] and [http://download.wikimedia.org/enwiki/20070802/ 2007-08-02] have both failed to dump 'All pages with complete edit history' in both the 7z and bz2 formats. There are no other enwiki dumps available in the [http://download.wikimedia.org/enwiki/ web directory]. Is there another source for the latest enwiki dumps that have the articles and their histories? Is there something terribly wrong going on with the dumping process for enwiki? Thanks. [[User:Bestchai|ivan]] 22:22, 30 September 2007 (UTC)

== And the October enwiki got cancelled/failed too. ==
I would like to get the current-pages dump for my offline palm reader, but the backups seem to be very random and inconsistant. I hope they don't have to be relied upon! Please can someone say if there is a problem with enwiki. Is the database corrupt?
Alun Liggins --[[User:77.96.111.181|77.96.111.181]] 23:19, 5 October 2007 (UTC)

== Image thumbnails ==
It would be a great idea to have just the thumbnails of images available. That might at least be feasible for now.

== Paid dumps ==
I would easily pay for a complete dump (especially for images). Private download or mailed hard disk.

== DEWIKI ==
The last is many days ago an something failed. A fresh clean and error-free one would be great. Thanks.

== Philosopedia.org ==
Please make a dump of philosopedia.org. We are moving to a new server and the current wiki is using the MyISAM format and we wish to import the data using INNODB. Thank you very much.

== pages-meta-history.xml.bz2 for University Research ==
Hi, we're looking to create a local full history dump of the english wikipedia for research purposes at the Center for the Study of Digital Libraries at Texas A&M University. However, we have been unable to locate any version of pages-meta-history.xml.bz2. If it can be attempted or if someone else who does have a copy could let us get ahold of it, we'd be very grateful. Thanks.

I would like to reiterate this request from the University of Nottingham, Uk. We are desperately trying to download a recent dump of wikipedia with revision history (pages-meta-history.xml.bz2), and none seems to be available. Even an old dump would be of use, but again we cannot find one. If anyone knows where one is available then we would be extremely grateful. Otherwise I would like to formally request a reattempt of the latest dump asap. Regards.

I would also like to request the full revision history (pages-meta-history.xml.bz2). The current links are "in progress" or broken. Even older versions would be acceptable. Thanks. --[[User:Dhardy|Dhardy]] 21:57, 5 February 2008 (UTC)

== full history dump for research purposes ==
Hi, I'd be interested in full dumps (pages-meta-history) of the en and de wikipedias for research purposes. Since these large XML-dumps apparently keep failing, I'd like to know whether MySQL-Dumps might be available or there is any other chance to get hold of the full data. [[User:Chassel|Chassel]] 08:03, 2 December 2007 (UTC)

== Another request for enwiki full history/pages-meta-history.xml.bz2 ==
Also needed for research purposes. The last full dump I have is from last year and is of course now horribly outdated. Could we either get: 1) a new dump (run to completion!) or 2) at least a copy of the aforementioned mid-August dump?

== DEWIKI ==
There is currently no DE Dump available. Can you please make a dump of it?
:: True. There is none. Maybe the Zeno lobbyists have won the toss to promote their proprietary software ;) I too would love to see a dewiki dump, because this is long ago we had a working one. -andy

:: Seconding that request. It says: "2007-11-14 19:08:09 dewiki: dump aborted" but there is also no way to access the previous dump. Is someone able to at least put back the previous version of http://download.wikimedia.org/dewiki/ in the meantime? Thanks!

[[Special:Contributions/84.149.74.117|84.149.74.117]] 09:21, 8 December 2007 (UTC)

Latest dumps (all current pages and all main pages) at [http://download.wikimedia.org/dewiki/20071217/]. ''[[en:User:Rich Farmbrough|Rich ]] [[en:User talk:Rich Farmbrough| Farmbrough]]'' 08:32 [[24 December]] [[2007]] (GMT).

== ESWIKI ==
I just want the spanish talk-pages of wikipedia, but would be really happy having at least the enormous full-pages version. Could you please make a dump of it? Thank you!

== Abstracts XML ==
The abstracts XML file is not currently compressed - is there a reason for this? I would like to download and process the abstracts file on a regular basis (i.e. each time a new version is available) and obviously it would be better if this file was compressed so it can be downloaded faster. Thanks.

== Image Tarballs ==
Is it possible to create the Image Tarballs another time? Espacially the German ones ;-)
thanks!

==Request for information on how to obtain entire Wikipedia on hard media==
I'd like to know if its possible to obtain the entire English Wikipedia (with full revision histories) on a hard disk, and if so, how much this would cost, and what options are available, i.e. do I send the hard disk, are images available, are you able to set it up so that its active, etc. This is for possible use on a private intranet for a non-profit organization. You may email me via the "Email this user" option. Thank you. [[User:Johntrask|Johntrask]] 18:37, 20 January 2008 (UTC)

Meta-Wiki - User contributions [en]

Requests for dumps