datarecipes

There are 0 repository under datarecipes topic.

NVIDIA / NeMo-Curator
Scalable data pre processing and curation toolkit for LLMs
data-curation llm data data-prep data-preparation data-processing data-processing-pipelines data-quality datacuration datarecipes deduplication fast-data-processing fine-tuning large-language-models large-scale-data-processing llmapps python llm-data-quality semantic-deduplication
Language:Jupyter Notebook 500
IBM / data-prep-kit
Open source project for data preparation of LLM application builders
data-preparation finetuning llm llmapps data data-prep data-preprocessing data-preprocessing-pipelines datacuration large-language-models large-scale-data-processing python ray spark datarecipes code-quality deduplication malware
Language:Python 206