richarddwang / hugdatafast

The elegant integration of huggingface/nlp and fastai2 and handy transforms using pure huggingface/nlp

hugdatafast

The elegant integration of huggingface/datasets and fastai, and some handy data transformation for huggingface/datasets.

🎓 Documentation : https://hugdatafast.readthedocs.io/en/latest/

Install

pip install hugdatafast

Furture Plan

• I would like to merge this library to fastai and huggingface/datasets respectively. But I may have no time for it. You're welcome to pr this library to the two libraries.

• The implemenatation of CombineTransform works but might be too complexed to extend, hope HuggingFace or someone come up with some great ideas.

• Currently, it is designed to work with the dataset part of huggingface/datasets, I may also integrate the part of metric or not.

Quick Intro