WikiParser

Wiki Parser is a high-performance tool designed to extract and convert MediaWiki-formatted pages from English Wikipedia into readable text and standard XML representation, focusing on data mining and text analysis. Noteworthy for its speed, it processes complete Wikipedia dumps (66 GB as of July 2018) in 2-3 hours using multithreaded C++ code, significantly outperforming other parsers by a factor of 10-100. The output retains structural elements such as titles and section headings, while deliberately omitting unsupported tags and complex table structures.