datarecipes

There are 0 repository under datarecipes topic.

NVIDIA / NeMo-Curator
Scalable data pre processing and curation toolkit for LLMs
data-curation llm data data-prep data-preparation data-processing data-processing-pipelines data-quality datacuration datarecipes deduplication fast-data-processing fine-tuning large-language-models large-scale-data-processing llmapps python llm-data-quality semantic-deduplication
Language:Jupyter Notebook 619
IBM / data-prep-kit
Open source project for data preparation of LLM application builders
code-quality data data-prep data-preparation data-preprocessing data-preprocessing-pipelines datacuration datarecipes deduplication finetuning large-language-models large-scale-data-processing llm llmapps malware python ray spark
Language:Jupyter Notebook 309