huggingface / datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Small issue on typeshelper

uselesscreature86 opened this issue · comments

commented

The typeshelper.py in the package downloaded by pip install datatrove[all] does not match the repo's typeshelper. I have to edit the source code. Can the next version make sure to include all languages in Languages?
image
image

Hi. The version on pypi is the latest stable version. For the latest dev version (the one here on github) you should clone the repository and run pip install -e .[all]