#Bookpedia input xml format how to
#Bookpedia input xml format update

How to do it: before importing the dump, run the query DELETE FROM interwiki WHERE iw_prefix='prefix' (note: do not include the colon in the prefix). This will preserve page titles, but prevent interwiki linking through that prefix.Įxample: you will preserve page titles 'Meta:Blah blah' but will not be able to use the prefix 'meta:' to link to (although it will be possible through a different prefix). Remove the prefix from the interwiki table.The problem is that some pages to be imported have a prefix that is used for interwiki linking.įor example, ones with a prefix of 'Meta:' would conflict with the interwiki prefix meta: which by default links to. Page 'meta:Blah blah' is not imported because its name is reserved for external linking (interwiki). See also: meta:Help:Import#Merging_histories_and_other_complications Please remark that the xml dump files produced by dumpBackup.php are prefixed by a namespace: Sometimes it is important that the page starts directly with the command, like for a #REDIRECT thus the comment giving the name of the page must be after the command but still on the first line. Please notice that the name of the page can be written in Unicode. The name of the page is in an html comment and separated by three quotes on the same first start line.

#Bookpedia input xml format update

open ( 'out_' + filename + '.wiki', 'w' ) commands used by 'pagefromfile' to create or update a page. new ( filename ), nil, 'UTF-8' ) puts filename. each do | filename | input = Nokogiri :: XML ( File. # The text of each page is searched with xpath and its title is added on the first line as # an html comment: this is required by pagefromfile.py. # -*- coding: utf-8 -*- # dumpxml2wiki.rb require 'rubygems' require 'nokogiri' # This program dumpxml2wiki reads MediaWiki xml files dumped by dumpBackup.php # on the current directory and transforms them into wiki files which can then # be modified and uploaded again by pywikipediabot using pagefromfile.py on a MediaWiki family site. The xml file created by dumpBackup.php can be transformed into a wiki file suitable to be processed by 'pagefromfile.py' using a simple Ruby program similar to the following (here the program will transform all xml files which are on the current directory which is needed if your MediaWiki site is a family): Once installed on your computer, you can use the specific tool ' pagefromfile.py' which lets you upload a wiki file on Wikipedia or MediaWiki sites. Pywikibot is a collection of tools written in python that automate work on Wikipedia or other MediaWiki sites. Using pywikibot, pagefromfile.py and Nokogiri This is not recommended for large data sets. You can also use the edit.php maintenance script for this purpose.įor large XML dumps, you can run rebuildall.php, but, it will take a long time, because it has to parse all pages. In MediaWiki 1.27 and later, you can use the importTextFiles.php maintenance script. If you have a lot of content converted from another source (several word processor files, content from another wiki, etc), you may have several files that you would like to import into your wiki. Using importTextFiles.php maintenance Script MediaWiki version: See: Manual:importDump.php, including tips on how to use it for large wikis. Using importDump.php, if you have shell access Recommended method for general use, but slow for very big data sets. This happens on MediaWiki versions prior to MediaWiki 1.26, and the solution is to restart the webserver service (apache, etc), or write and execute a script that calls libxml_disable_entity_loader(false) (see task T86036). Warning: XMLReader::read(): Load Data before trying to read in /./wiki/includes/Import.php on line 399Īnd Special:Import shows: ' Import failed: Expected tag, got ', this may be a problem caused by a fatal error on a previous import, which leaves libxml in a wrong state across the entire server, or because another PHP script on the same server disabled entity loader ( PHP bug).

Warning: XMLReader::open(): Unable to open source data in /./wiki/includes/Import.php on line 53 $wgGroupPermissions = true $wgGroupPermissions = true Possible problems įor using Transwiki-Import PHP safe_mode must be off and 'open_basedir' must be empty (both of them are variables in php.ini).