finetuning

There are 1 repository under finetuning topic.

unslothai / unsloth
Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
ai fine-tuning finetuning gemma llama llama3 llms lora mistral phi3 qlora
Language:Python 12911
meta-llama / llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
ai finetuning langchain llama llama2 llm machine-learning python pytorch vllm
Language:Jupyter Notebook 10536
microsoft / FLAML
A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
automl hyperparam automated-machine-learning machine-learning data-science python jupyter-notebook hyperparameter-optimization random-forest scikit-learn deep-learning natural-language-processing natural-language-generation timeseries-forecasting classification regression tuning finetuning tabular-data
Language:Jupyter Notebook 3788
h2oai / h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
ai chatbot chatgpt fine-tuning finetuning generative generative-ai gpt llama llama2 llm llm-training
Language:Python 3784
Dataherald / dataherald
Interact with your SQL database, Natural Language to SQL using LLMs
ai database finetuning llm nl-to-sql rag sql text-to-sql
Language:Python 3240
learn2learn
learnables / learn2learn
A PyTorch Library for Meta-learning Research
few-shot finetuning learn2learn learning2learn maml meta-descent meta-learning meta-optimization meta-rl metalearning pytorch
Language:Python 2590
stochasticai / xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
deep-learning fine-tuning gpt-2 gpt-j llama llm lora language-model alpaca finetuning adapter gen-ai generative-ai mistral mixed-precision peft quantization
Language:Python 2565
finetuner
jina-ai / finetuner
:dart: Task-oriented embedding tuning for BERT, CLIP, etc.
bert few-shot-learning fine-tuning finetuning jina metric-learning negative-sampling neural-search openai-clip pretrained-models siamese-network similarity-learning transfer-learning triplet-loss
Language:Python 1454
eosphoros-ai / Awesome-Text2SQL
Curated tutorials and resources for Large Language Models, Text2SQL, Text2DSL、Text2API、Text2Vis and more.
ai awesome datset deep-learning finetuning llm nl-to-sql nl2sql nlp survey test text-to-sql text2api text2dsl text2sql
1393
georgian-io / LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
classification fine-tuning finetuning large-language-models nlp nlp-machine-learning summarization falcon flan-t5 llama2 lora qlora redpajama ablation-study llm-test mistral-7b unit-testing zephyr
Language:Python 743
xing61 / zzz-api
优质稳定的OpenAI的API接口-For企业和开发者。OpenAI的api proxy，支持ChatGPT的API调用，支持openai的API接口，支持：gpt-4，gpt-3.5。不需要openai Key, 不需要买openai的账号，不需要美元的银行卡，通通不用的，直接调用就行，稳定好用！！智增增
chatgpt china embedding finetune finetuning gpt gpt-35-turbo gpt4 openai openai-api openai-proxy prompt proxy
Language:PHP 541
minosvasilias / godot-dodo
Finetuning large language models for GDScript generation.
ai finetuning gdscript godot llama
Language:Python 516
LazyAGI / LazyLLM
Easyest and lazyest way for building multi-agent LLMs applications.
llms ai-agent deep-learning langchain llamaindex rag agents data finetuning framework llm documentation-tool knowlege-graph lazyllm
Language:Python 500
junxia97 / awesome-pretrain-on-molecules
[IJCAI 2023 survey track]A curated list of resources for chemical pre-trained models
awesome chemical-language-models computational-chemistry drug-discovery drug-discovery-and-development finetuning gnns graph-representation-learning molecular-representation-learning molecule self-supervised-learning survey transfer-learning
472
daswer123 / xtts-webui
Webui for using XTTS and for finetuning it
cocqui finetuning tts xtts xttsv2
Language:Python 464
Xirider / finetune-gpt2xl
Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed
huggingface huggingface-transformers deepspeed gpt2 gpt3 finetuning gpt-neo gpt-neo-fine-tuning
Language:Python 426
microsoft / AzureML-BERT
End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service
azure-machine-learning bert nlp pytorch pretrained-models finetuning pretraining bert-model azureml-bert tuning language-model
Language:Jupyter Notebook 389
aikit
sozercan / aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai buildkit chatgpt docker fine-tuning finetuning gemma gpt inference kubernetes large-language-models llama llm localllama mistral mixtral nvidia open-llm open-source-llm openai
Language:Go 304
helixml / helix
Multi-node production AI stack. Run the best of open source AI easily on your own servers. Create your own AI by fine-tuning open source models. Integrate LLMs with APIs. Run gptscript securely on the server
golang llama llm mistral openai self-hosted mixtral sdxl stable-diffusion api finetuning function-calling llm-agent llm-serving openapi rag swagger helm k8s gptscript
Language:Go 286
baidubce / bce-qianfan-sdk
Provide best practices for LMOps, as well as elegant and convenient access to the features of the Qianfan MaaS Platform. (提供大模型工具链最佳实践，以及优雅且便捷地访问千帆大模型平台）
chat embeddings finetuning llm baidu bce ernie-bot qianfan lmops maas
Language:Jupyter Notebook 278
kingTLE / literary-alpaca2
从词表到微调这就是你所需的一切
finetuning llama2 nlp pretraining
Language:Python 255
LHRLAB / ChatKBQA
[ACL 2024] Official resources of "ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models".
knowledge-graph semantic-parsing sparql-query graph-database finetuning large-language-models
Language:Python 230
gyunggyung / KoGPT2-FineTuning
🔥 Korean GPT-2, KoGPT2 FineTuning cased. 한국어 가사 데이터 학습 🔥
nlp gpt2 kogpt2 finetuning korean-nlp fine-tuning korean text-generation lyrics-generator language-model
Language:Python 229
promptslab / LLMtuner
FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
fine-tuning fine-tuning-llm finetune finetune-llm finetuning llm llm-framework llm-inference llm-training llmops finetune-gpt finetune-llama finetune-llms finetune-whisper llmtuner finetuning-large-language-models finetuning-rl finetunechatgpt whisper whisper-finetune
Language:Python 210
rasbt / dora-from-scratch
LoRA and DoRA from Scratch Implementations
finetuning llm pytorch
Language:Jupyter Notebook 169
git-cloner / llama2-lora-fine-tuning
llama2 finetuning with deepspeed and lora
deepspeed finetuning llama2 lora
Language:Python 156
ssbuild / chatglm2_finetuning
chatglm2 6b finetuning and alpaca finetuning
finetuning lora qlora deep-training chatglm chatglm2 chatglm2-6b ia3
Language:Python 144
adithya-s-k / AI-Engineering.academy
a friendly neighborhood repository with diverse experiments and adventures in the world of LLMs
fine-tuning finetuning finetuning-llms inference large-language-models llm python quantization
Language:Jupyter Notebook 140
JosefAlbers / Phi-3-Vision-MLX
Phi-3 for Mac: Locally-run Vision and Language Models for Apple Silicon
fine-tuning finetuning llm lora mac macos metal mlx phi-3 phi-3-mini phi-3-vision vlm agent api multi-agent-systems multimodal
Language:Jupyter Notebook 139
woctezuma / finetune-detr
Fine-tune Facebook's DETR (DEtection TRansformer) on Colaboratory.
balloon balloons colab colab-notebook colaboratory detr facebook finetune finetunes finetuning google-colab google-colab-notebook google-colaboratory instance instance-segmentation instances segementation segment
Language:Jupyter Notebook 136
git-cloner / llama-lora-fine-tuning
llama fine-tuning with lora
finetuning llama lora
Language:Python 130
kuutsav / llm-toys
Small finetuned LLMs for a diverse set of useful tasks
falcon-7b finetuning gpt llm qlora paraphrase-generation dialogue-summarization
Language:Python 117
Trainy-ai / llm-atc
Fine-tuning and serving LLMs on any cloud
finetuning llama2 llms vllm
Language:Python 83
yifanzhang-pro / AutoMathText
Official implementation of DPFM @ ICLR 2024 paper "AutoMathText: Autonomous Data Selection with Language Models for Mathematical Texts" (Huggingface Daily Papers: https://huggingface.co/papers/2402.07625)
finetuning large-language-models llm math-ai mathematics pretraining reasoning
Language:Python 65
praetor-data
US-Artificial-Intelligence / praetor-data
Praetor is a lightweight finetuning data and prompt management tool
ml neural neural-network data data-management flask finetuning ai fine-tuning
Language:Python 64
kamalkraj / e5-mistral-7b-instruct
Finetune mistral-7b-instruct for sentence embeddings
finetuning huggingface lora mistral-7b peft pytorch sentence-embeddings transformers
Language:Python 62

finetuning

unslothai / unsloth

meta-llama / llama-recipes

microsoft / FLAML

h2oai / h2o-llmstudio

Dataherald / dataherald

learnables / learn2learn

stochasticai / xTuring

jina-ai / finetuner

eosphoros-ai / Awesome-Text2SQL

georgian-io / LLM-Finetuning-Toolkit

xing61 / zzz-api

minosvasilias / godot-dodo

LazyAGI / LazyLLM

junxia97 / awesome-pretrain-on-molecules

daswer123 / xtts-webui

Xirider / finetune-gpt2xl

microsoft / AzureML-BERT

sozercan / aikit

helixml / helix

baidubce / bce-qianfan-sdk

kingTLE / literary-alpaca2

LHRLAB / ChatKBQA

gyunggyung / KoGPT2-FineTuning

promptslab / LLMtuner

rasbt / dora-from-scratch

git-cloner / llama2-lora-fine-tuning

ssbuild / chatglm2_finetuning

adithya-s-k / AI-Engineering.academy

JosefAlbers / Phi-3-Vision-MLX

woctezuma / finetune-detr

git-cloner / llama-lora-fine-tuning

kuutsav / llm-toys

Trainy-ai / llm-atc

yifanzhang-pro / AutoMathText

US-Artificial-Intelligence / praetor-data

kamalkraj / e5-mistral-7b-instruct