attardi / wikiextractor

A tool for extracting plain text from Wikipedia dumps

attardi/wikiextractor Issues

ValueError: cannot find context for 'fork' & cannot pickle '_io.TextIOWrapper' object
Updated 2 months ago2
--json flag is unrecognised
Updated 2 months ago3
Option to remove blank pages?
Updated 2 months ago1
How to store a document in a separate txt file instead of a single txt file containing multiple documents
Updated 2 months ago
Wikidata Extraction
Updated 6 months ago
wikiextractor 3.0.6 not extracting
Closed a year ago3
Parsing seems to exclude some part of the page
Updated 6 months ago
文章摘要抽取不到数据
Updated 7 months ago4
does not extract all wiki
Updated 8 months ago
Bullet points are missing in the final extracted text
Updated 8 months ago
[Request for Help] Should I support a template file like `templates.txt` followed the arg `--templates`?
Updated 9 months ago
Template errors in article
Updated 9 months ago2
Add feature to extractPage to also dump the extracted page to json/csv/txt
Updated 9 months ago
ptwiki-latest error
Updated a year ago2
Question ValueError: cannot find context for 'fork'
Closed a year ago4
Is Windows 10 supported?
Closed a year ago28
Is Windows supported
Closed a year ago
Warning: Template Errors
Updated a year ago1
Never finishes and even debug gets stuck in a loop
Updated a year ago
Why was --keep_tables removed?
Updated a year ago
Warning: Template Errors
Closed 2 years ago5
Option to drop section titles/headers
Updated a year ago1
Issues on newer (2023) and older (2019) dumps
Closed a year ago
Question: Cirrus Extractor vs. "normal" Extractor - who creates cleaner texts?
Updated a year ago1
How to extract lists pages?
Updated a year ago
Various tags such as q, br, ins, del are not fitered out
Updated a year ago1
Non-textual elements score and mapframe are not filtered out
Updated a year ago
Cannot turn off --html-safe command line option (true by default)
Updated a year ago
Tables are not entirely filtered out
Updated a year ago
KeyError in 'page.append(listItem[n] % line)'
Updated 2 years ago
fails on the first file
Updated 2 years ago2
about "raise BdbQuit" problem
Updated 2 years ago10
KeyError for producing HTML output with `--html`
Updated 2 years ago1
ModuleNotFoundError: No module named '__main__.extract'; '__main__' is not a package
Updated 2 years ago
Template not correctly expanded
Updated 2 years ago2
how to get mention/anchor by wikiextractor.
Updated 2 years ago
TagRE Causes Loss of Large Portion of Page Text
Closed 2 years ago
How to preserve sections?
Updated 2 years ago1
File output does not match stdout output in v3.0.6
Updated 2 years ago
Unwanted pdb tracing
Updated 2 years ago3
Codec encoding errors in OutputSplitter
Updated 2 years ago
Extraction of french wikipedia has lacks and syntaxic faults
Updated 2 years ago1
Found a possible security concern
Updated 2 years ago
templates are not extracted correctly
Updated 3 years ago
Status of release 3.0.4 / 3.0.5?
Updated 3 years ago
cannot serialize/pickle '_io.TextIOWrapper' object
Updated 3 years ago5
Would be nice to continue after interrupt
Updated 3 years ago
[Feature Request]: Capture Paragaph Heading information
Updated 3 years ago1
"revid" is incorrectly the page.revision.contributor.id, when it should be the page.revision.id
Updated 3 years ago2
'{{snd}}' should resolve to '–' or '-'
Updated 3 years ago