llm-training

There are 10 repositories under llm-training topic.

ludwig
ludwig-ai / ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
deep-learning deeplearning deep learning machine-learning machinelearning natural-language-processing natural-language computer-vision data-centric data-science pytorch neural-network ml llm llm-training fine-tuning llama mistral llama2
Language:Python 10862
liguodongiot / llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
llm llm-inference llm-serving llm-training llmops
Language:HTML 6617
skypilot-org / skypilot
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
cloud-computing cloud-management cost-management cost-optimization data-science deep-learning distributed-training finops gpu hyperparameter-tuning job-queue job-scheduler llm-serving llm-training machine-learning ml-infrastructure ml-platform multicloud spot-instances tpu
Language:Python 5731
h2oai / h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
ai chatbot chatgpt fine-tuning finetuning generative generative-ai gpt llama llama2 llm llm-training
Language:Python 3643
InternLM / xtuner
An efficient, flexible and full-featured toolkit for fine-tuning large models (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
agent baichuan chatbot chatglm2 chatglm3 conversational-ai internlm large-language-models llama2 llama3 llava llm llm-training mixtral msagent peft phi3 qwen supervised-finetuning
Language:Python 2737
databricks / dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
databricks gen-ai generative-ai llm llm-inference llm-training mosaic-ai
Language:Python 2426
intelligent-machine-learning / dlrover
DLRover: An Automatic Distributed Deep Learning System
distributed-training k8s llm-training
Language:Python 982
utkuozdemir / nvidia_gpu_exporter
Nvidia GPU exporter for prometheus using nvidia-smi binary
ai cryptocurrency gaming llm llm-training monitoring nvidia nvidia-gpu nvidia-smi prometheus prometheus-exporter
Language:Go 665
ghimiresunil / LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
bert huggingface large-language-models llm-inference llm-training open-source open-source-llm transformers llm-tutorials
Language:Jupyter Notebook 481
anarchy-ai / LLM-VM
irresponsible innovation. Try now at https://chat.dev/
artificial-intelligence deep-learning distillation distillation-model llm llm-agent llm-inference llm-local llm-training machine-learning
Language:Python 456
mallorbc / Finetune_LLMs
Repo for fine-tuning Casual LLMs
docker falcon gpt gpt-3 gpt-35-turbo gpt-4 gpt-j-6b llama llama2 llm llm-training mpt
Language:Python 441
FlagAI-Open / Aquila2
The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
llm llm-inference llm-training
Language:Python 423
tigerlab-ai / tiger
Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
classification fine-tuning llm llm-training rag ai-safety data-augmentation large-language-models aisafety
Language:Jupyter Notebook 386
volcengine / veScale
A PyTorch Native LLM Training Framework
llm-training pytorch
Language:Python 370
rohan-paul / LLM-FineTuning-Large-Language-Models
LLM (Large Language Model) FineTuning
gpt-3 gpt3-turbo large-language-models llama2 llm llm-finetuning llm-inference llm-serving llm-training mistral-7b open-source-llm pytorch
Language:Jupyter Notebook 358
promptslab / LLMtuner
Tune LLM in few lines of code
fine-tuning fine-tuning-llm finetune finetune-llm finetuning llm llm-framework llm-inference llm-training llmops finetune-gpt finetune-llama finetune-llms finetune-whisper llmtuner finetuning-large-language-models finetuning-rl finetunechatgpt whisper whisper-finetune
Language:Python 199
substratusai / runbooks
Finetune LLMs on K8s by using Runbooks
kubernetes mlops llmops kubernetes-operator llm-inference llm-serving llm-training ml-platform
Language:Go 158
armbues / SiLLM
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
apple-silicon dpo large-language-models llm llm-inference llm-training lora mlx
Language:Python 146
feifeibear / long-context-attention
Sequence Parallel Attention for Long Context LLM Model Training and Inference
attention-is-all-you-need deepspeed-ulysses llm-inference llm-training pytorch ring-attention
Language:Python 123
aws-samples / awsome-distributed-training
Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
aws awsbatch efa eks generative-ai gpu hyperpod llm llm-training parallelcluster
Language:Python 117
shivendrra / SmallLanguageModel-project
a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
bert-model decoder-model gpt llm-training llms machine-learning neural-networks transformer llm-cookbook
Language:Jupyter Notebook 105
MatX-inc / seqax
seqax = sequence modeling + JAX
llm-training
Language:Python 90
slai-labs / get-beam
Run GPU inference and training jobs on serverless infrastructure that scales with you.
artificial-intelligence machine-learning python serverless cloud-computing cost-optimization data-science deep-learning distributed-computing gpu-acceleration gpu-computing hpc llm-serving llm-training ml-infrastructure mlops serverless-architectures
Language:Shell 88
vihangd / alpaca-qlora
Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA
fine-tuning llm-training llms
Language:Python 80
dsdanielpark / open-llm-datasets
Repository for organizing datasets and papers used in Open LLM.
datasets large-language-models llm llm-datasets llm-training natural-language-processing
74
SmerkyG / gptcore
Fast modular code to create and train cutting edge LLMs
gpt llm-training llms machine-learning
Language:Python 61
discus-labs / discus
A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ
llms synthetic-data synthetic-dataset-generation fine-tuning llm-datasets llm-training fine-tuning-llm gpt gpt-4 huggingface-transformers large-language-models ner-data openai python
Language:Python 60
Itachi-Uchiha581 / Auto-Data
Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
ai data finetuning-large-language-models finetuning-llms generative-ai llm llm-training python python3
Language:Python 56
muyu42 / DataS
本项目旨在结合以往研究人员的代表性工作，从多个维度评估sft数据，并自动化过滤sft数据。
data-engineering llm-training sft
Language:Python 52
sugarcane-ai / sugarcane-ai
npm like package ecosystem for Prompts 🤖
ai llm prompt-engineering framework llm-chain llm-framework llm-serving llm-training llmops next packages performance prompts llm-finetuning
Language:TypeScript 46
sec3-service / Owl-LM
Large Language Model for Blockchain
blockchain llm llm-training
Language:Jupyter Notebook 45
lenguajenatural-ai / autotransformers
A Python package for automatically training and comparing language models.
language-model llm-training llms nlp
Language:Python 38
microsoft / LLF-Bench
A benchmark for evaluating learning agents based on just language feedback
large-language-models llm llm-training llms machine-learning natural-language-processing reinforcement-learning
Language:Python 35
sotopia-lab / sotopia-pi
Sotopia-π: Interactive Learning of Socially Intelligent Language Agents (ACL 2024)
agents llm-training reinforcement-learning social-intelligence
Language:Python 35
adithya-s-k / CompanionLLM
CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion
fine-tuning huggingface llama llama2 llamacpp lora peft mit-license open-source finetuning llm llm-inference llm-training hacktoberfest hacktoberfest2023 hacktoberfest-accepted
Language:Jupyter Notebook 34
microsoft / MathOctopus
This repository contains resources for accessing the official benchmarks, codes, and checkpoints of the paper: "[**Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations**]".
llm-training
Language:Python 33