fine-tuning

There are 30 repositories under fine-tuning topic.

run-llama / llama_index
LlamaIndex is a data framework for your LLM applications
agents application data fine-tuning framework llamaindex llm rag vector-database
Language:Python 31691
LLaMA-Factory
hiyouga / LLaMA-Factory
Unify Efficient Fine-Tuning of 100+ LLMs
fine-tuning language-model llama llm peft transformers rlhf qlora quantization chatglm qwen instruction-tuning mistral gpt lora large-language-models agent ai moe llama3
Language:Python 22158
ludwig
ludwig-ai / ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
deep-learning deeplearning deep learning machine-learning machinelearning natural-language-processing natural-language computer-vision data-centric data-science pytorch neural-network ml llm llm-training fine-tuning llama mistral llama2
Language:Python 10859
unslothai / unsloth
Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory
ai fine-tuning finetuning gemma llama llama2 llms lora mistral qlora
Language:Python 9630
bentoml / OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna bentoml llama2 llm-inference llm-ops open-source-llm openllm ai mistral ml mlops
Language:Python 8928
cloneofsimo / lora
Using Low-rank adaptation to quickly fine-tune diffusion models.
diffusion lora stable-diffusion dreambooth fine-tuning
Language:Jupyter Notebook 6647
flyte
flyteorg / flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
flyte machine-learning golang scale workflow data-science data-analysis data kubernetes-operator kubernetes orchestration-engine mlops dataops grpc python production production-grade declarative fine-tuning llm
Language:Go 4840
h2oai / h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
ai chatbot chatgpt fine-tuning finetuning generative generative-ai gpt llama llama2 llm llm-training
Language:Python 3635
hiyouga / ChatGLM-Efficient-Tuning
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
chatglm chatgpt fine-tuning lora alpaca peft huggingface language-model transformers pytorch rlhf chatglm2 qlora
Language:Python 3611
ZhaoJ9014 / face.evoLVe
🔥🔥High-Performance Face Recognition Library on PaddlePaddle & PyTorch🔥🔥
pytorch face-recognition face-detection face-alignment face-landmark-detection model-training feature-extraction fine-tuning data-augmentation deep-learning computer-vision imbalanced-learning transfer-learning hard-negative-mining supervised-learning nus tencent convolutional-neural-network machine-learning artificial-intelligence
Language:Python 3358
dbiir / UER-py
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
bert pre-training fine-tuning gpt chinese natural-language-processing pytorch elmo classification ner t5 unilm roberta albert clue gpt-2 model-zoo bart pegasus xlm-roberta
Language:Python 2916
stochasticai / xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
deep-learning fine-tuning gpt-2 gpt-j llama llm lora language-model alpaca finetuning adapter gen-ai generative-ai mistral mixed-precision peft quantization
Language:Python 2528
YiVal / YiVal
Your Automatic Prompt Engineering Assistant for GenAI Applications
ai prompt llm ai-experiments ai-toolkit promptengineering aigc generative-ai prompt-engineering fine-tuning prompt-tuning api autogpt framework gpt4 midjourney python stable-diffusion auto-prompting
Language:Python 2450
iusztinpaul / hands-on-llms
🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
bytewax comet-ml huggingface mlops qdrant transformers beam langchain generative-ai llms 3-pipeline-design aws cicd fine-tuning llmops qlora streaming docker
Language:Jupyter Notebook 2432
adobe-research / custom-diffusion
Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)
customization fine-tuning text-to-image-generation computer-vision diffusion-models few-shot pytorch
Language:Python 1787
ashishpatel26 / LLM-Finetuning
LLM Finetuning with peft
falcon fine-tuning huggingface llama llama2 llm llms lora peft pytorch text-generation
Language:Jupyter Notebook 1664
predibase / lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers
Language:Python 1612
llm-applications
ray-project / llm-applications
A comprehensive guide to building RAG-based LLM applications for production.
anyscale fine-tuning llama2 llms machine-learning openai ray serving
Language:Jupyter Notebook 1526
kubeflow / training-operator
Distributed ML Training and Fine-Tuning on Kubernetes
ai distributed fine-tuning gpu huggingface jax kubeflow kubernetes llm machine-learning mlops python pytorch tensorflow xgboost
Language:Go 1465
google-deepmind / penzai
A JAX research toolkit for building, editing, and visualizing neural networks.
fine-tuning interpretability jax neural-networks visualization
Language:Python 1464
smallcloudai / refact
WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
ai autocompletion chat refactoring fine-tuning self-hosted llama2 llms starchat starcoder wizardlm devtools developer-tools
Language:JavaScript 1436
finetuner
jina-ai / finetuner
:dart: Task-oriented embedding tuning for BERT, CLIP, etc.
fine-tuning pretrained-models few-shot-learning negative-sampling metric-learning siamese-network triplet-loss transfer-learning jina neural-search finetuning similarity-learning bert openai-clip
Language:Python 1434
cognita
truefoundry / cognita
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
agent ai application data deep-learning fine-tuning framework generative-ai llm llm-ops llmops machine-learning mlops model-deployment python rag retrieval-augmented-generation typescript
Language:Python 1327
OneTrainer
Nerogar / OneTrainer
OneTrainer is a one-stop solution for all your stable diffusion training needs.
fine-tuning lora stable-diffusion training
Language:Python 1174
dstackai / dstack
An open-source container orchestration engine for running AI workloads in any cloud or data center. https://discord.gg/u8SmfwPpMd
machine-learning python aws azure gcp gpu llms cloud orchestration fine-tuning
Language:Python 1123
eosphoros-ai / DB-GPT-Hub
A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL
sql text2sql gpt llm text-to-sql datasets nl2sql database fine-tuning
Language:Python 1070
Tencent / TencentPretrain
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
albert bart bert chinese classification clue elmo fine-tuning gpt gpt-2 model-zoo natural-language-processing ner pegasus pre-training pytorch roberta t5 unilm xlm-roberta
Language:Python 986
AGI-Edgerunners / LLM-Adapters
Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
adapters fine-tuning large-language-models parameter-efficient
Language:Python 960
lonePatient / Bert-Multi-Label-Text-Classification
This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.
pytorch pytorch-implmention nlp multi-label-classification text-classification bert fine-tuning xlnet transformers albert
Language:Python 836
RL-VIG / LibFewShot
LibFewShot: A Comprehensive Library for Few-shot Learning. TPAMI 2023.
few-shot-learning fine-tuning image-classification meta-learning pytorch
Language:Python 836
uclaml / SPIN
The official implementation of Self-Play Fine-Tuning (SPIN)
deep-learning fine-tuning large-language-models self-play
Language:Python 822
MrGiovanni / ModelsGenesis
[MICCAI 2019] [MEDIA 2020] Models Genesis
fine-tuning representation-learning transfer-learning self-supervised-learning 3d-model pre-trained-model foundation-models
Language:Jupyter Notebook 722
haofanwang / Lora-for-Diffusers
The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥
aigc diffusers fine-tuning guidebook lora stable-diffusion stable-diffusion-webui text-to-image colossalai
Language:Python 707
georgian-io / LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
classification fine-tuning finetuning large-language-models nlp nlp-machine-learning summarization falcon flan-t5 llama2 lora qlora redpajama ablation-study llm-test mistral-7b unit-testing zephyr
Language:Python 677
DataDreamer
datadreamer-dev / DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
deep-learning machine-learning natural-language-processing nlp nlp-library python pytorch transformers alignment fine-tuning gpt instruction-tuning llm llmops llms openai synthetic-data synthetic-dataset-generation
Language:Python 672
neosync
nucleuscloud / neosync
Open source data anonymization and synthetic data orchestration for developers. Create high fidelity synthetic data and sync it across your environments.
benthos docker etl faker fine-tuning golang kubernetes nextjs open-source orchestration protobuf react reactjs self-hosted synthetic-data synthetic-data-generation test-data-generator testing typescript
Language:TypeScript 653