Experimental data pipeline in Python with Haystack.
Install the environment with Anaconda, see environment.yml.
The key libraries are the Haystack libraries on PyPI:
farm-haystack
farm-haystack[crawler]
Also, datasets and pretrained models are from Huggingface:
datasets
MIT License, see the LICENSE file.