lora

There are 67 repositories under lora topic.

annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
deep-learning deep-learning-tutorial pytorch gan transformers reinforcement-learning optimizers neural-networks transformer machine-learning attention literate-programming lora
Language:Python 63212
LLaMA-Factory
hiyouga / LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
fine-tuning llama llm peft transformers rlhf qlora quantization qwen instruction-tuning gpt lora large-language-models agent ai moe llama3 deepseek gemma nlp
Language:Python 58291
unsloth
unslothai / unsloth
Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.
fine-tuning llama llms lora mistral gemma llama3 unsloth llm deepseek deepseek-r1 gemma3 text-to-speech tts qwen qwen3 agent ai openai gpt-oss
Language:Python 45475
datawhalechina / self-llm
《开源大模型食用指南》针对**宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
llm chatglm internlm2 llama3 lora minicpm qwen qwen1-5 chatglm3 gemma-2b-it glm-4 qwen2 q-wen
Language:Jupyter Notebook 24333
huggingface / peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
adapter diffusion fine-tuning llm lora parameter-efficient-learning peft python pytorch transformers
Language:Python 19576
Chinese-LLaMA-Alpaca
ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llm plm pre-trained-language-models alpaca llama nlp quantization large-language-models lora alpaca-2 llama-2
Language:Python 18920
camenduru / stable-diffusion-webui-colab
stable diffusion webui colab
ai ai-art colab colab-notebook colaboratory deep-learning dreambooth gradio image-generation img2img lora pytorch stable-diffusion stable-diffusion-web-ui stable-diffusion-webui t2v text2video texttovideo txt2img
Language:Jupyter Notebook 15928
microsoft / LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
adaptation deberta deep-learning gpt-2 gpt-3 language-model lora low-rank pytorch roberta
Language:Python 12681
LianjiaTech / BELLE
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
bloom chinese-nlp gpt-evaluation gpt-q instruct-finetune instruct-gpt instruction-set llama lora open-models
Language:HTML 8116
cloneofsimo / lora
Using Low-rank adaptation to quickly fine-tune diffusion models.
diffusion lora stable-diffusion dreambooth fine-tuning
Language:Jupyter Notebook 7439
modelscope / ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen2.5, InternLM3, GLM4, Mistral, Yi1.5, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Llama4, Llava, InternVL2.5, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, DeepSeek-VL2, Phi3.5-Vision, GOT-OCR2, ...).
deepseek-r1 deploy distill embedding grpo internvl liger llama llama4 llm lora megatron multimodal omni open-r1 peft qwen2-5 qwen2-vl rft sft
Language:Python 6863
yangjianxin1 / Firefly
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
alpaca aquila baichuan chatglm gemma gpt internlm llama llama2 llama3 llm lora minicpm mistral mixtral peft qlora qwen qwen2 zephyr
Language:Python 6546
lyogavin / airllm
AirLLM 70B inference with single 4GB GPU
chinese-llm chinese-nlp finetune generative-ai instruct-gpt instruction-set llama llm lora open-models open-source open-source-models qlora
Language:Jupyter Notebook 5758
Akegarasu / lora-scripts
SD-Trainer. LoRA & Dreambooth training scripts & GUI use kohya-ss's trainer, for diffusion model.
dreambooth finetune lora stable-diffusion
Language:Python 5670
meshtastic / firmware
The official firmware for Meshtastic, an open-source, off-grid mesh communication system.
gps lora hiking ttgo-tbeam heltec meshtastic ttgo esp32 nrf52 mesh-networks off-grid mesh pico rp2040 stm32
Language:C++ 5547
ExpressLRS / ExpressLRS
ESP32/ESP8285-based High-Performance Radio Link for RC applications
rc lora esp8266 esp32 fpv quadcopter remote-control sx1280 sx1276 drone lr1121
Language:C++ 4379
OpenMQTTGateway
1technophile / OpenMQTTGateway
MQTT gateway for ESP8266 or ESP32 with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermometer compatibility & LoRa.
mqtt gateway openhab2 home-automation home-assistant wemos-d1 rcswitch arduino bridge nodemcu ble-beacons esp8266 arduino-uno miflora esp32 xiaomi ble lora platformio
Language:C++ 3851
mymusise / ChatGLM-Tuning
基于ChatGLM-6B + LoRA的Fintune方案
chatglm chatgpt lora peft
Language:Python 3764
hiyouga / ChatGLM-Efficient-Tuning
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
alpaca chatglm chatglm2 chatgpt fine-tuning huggingface language-model lora peft pytorch qlora rlhf transformers
Language:Python 3714
agentheroes / agentheroes
Generate, animate and schedule your AI characters 🤖
agent agents ai chatgpt generate image lora replicate train video workflow
Language:TypeScript 3311
wenge-research / YAYI
雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型，由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)
bloom chat chinese llama llama2 llm lora yayi
Language:Python 3263
predibase / lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers
Language:Python 2920
PhoebusSi / Alpaca-CoT
We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！
chatglm llama llm lora chatgpt cot instruction-tuning alpaca moss p-tuning parameter-efficient pytorch tabul tabular-data tabular-model
Language:Jupyter Notebook 2769
liucongg / ChatGLM-Finetuning
基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等
chatglm chatglm2 chatglm3 chatgpt freeze lora p-tuning
Language:Python 2738
adapter-hub / adapters
A Unified Library for Parameter-Efficient and Modular Transfer Learning
adapters bert lora natural-language-processing nlp parameter-efficient-learning parameter-efficient-tuning pytorch transformers
Language:Jupyter Notebook 2680
stochasticai / xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
deep-learning fine-tuning gpt-2 gpt-j llama llm lora language-model alpaca finetuning adapter gen-ai generative-ai mistral mixed-precision peft quantization
Language:Python 2658
dvlab-research / LongLoRA
Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
fine-tuning-llm large-language-models llm long-context lora
Language:Python 2655
absmach / supermq
Event-driven Infrastructure for Modern Cloud
golang iot-platform edge-computing distributed-systems iot-cloud iot-gateway message-broker mqtt coap web-socket lorawan opc-ua iiot lora iot internet-of-things lwm2m messaging edge telecom
Language:Go 2530
markqvist / Reticulum
The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.
lora mesh mesh-networks network networking-stack packet-radio reticulum rns
Language:Python 2501
OneTrainer
Nerogar / OneTrainer
OneTrainer is a one-stop solution for all your stable diffusion training needs.
fine-tuning lora stable-diffusion training
Language:Python 2481
ashishpatel26 / LLM-Finetuning
LLM Finetuning with peft
falcon fine-tuning huggingface llama llama2 llm llms lora peft pytorch text-generation
Language:Jupyter Notebook 2407
chenking2020 / FindTheChatGPTer
ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利
agi alpaca autogpt baichuan belle ceval chatglm chatgpt codi guanaco learderboard linly llama llama2 llava lora minigpt4 self-instruct vicuna wizadlm
2033
onediff
siliconflow / onediff
OneDiff: An out-of-the-box acceleration library for diffusion models.
comfyui diffusers pytorch sdxl stable-diffusion aigc-serving comfyui-workflow cuda inference-engine lcm lcm-lora performance-optimization sd-webui stable-video-diffusion diffusion-models lora sdxl-turbo
Language:Jupyter Notebook 1936
cyberman54 / ESP32-Paxcounter
Wifi & BLE driven passenger flow metering with cheap ESP32 boards
wifi ttgo lopy heltec ttn lorawan lora thethingsnetwork esp32 platformio macaddr bme680 gps gps-tracker pycom arduino dcf77 helium-network iot mqtt
Language:C++ 1930
ssbuild / chatglm_finetuning
chatglm 6b finetuning and alpaca finetuning
chatglm deep-learning lora pytorch p-tuning-v2 adalora sft freeze qlora ia3
Language:Python 1542
brocaar / chirpstack-network-server
ChirpStack Network Server is an open-source LoRaWAN network-server.
internet-of-things iot lora lora-server loraserver lorawan network-server
Language:Go 1514

lora

labmlai / annotated_deep_learning_paper_implementations

hiyouga / LLaMA-Factory

unslothai / unsloth

datawhalechina / self-llm

huggingface / peft

ymcui / Chinese-LLaMA-Alpaca

camenduru / stable-diffusion-webui-colab

microsoft / LoRA

LianjiaTech / BELLE

cloneofsimo / lora

modelscope / ms-swift

yangjianxin1 / Firefly

lyogavin / airllm

Akegarasu / lora-scripts

meshtastic / firmware

ExpressLRS / ExpressLRS

1technophile / OpenMQTTGateway

mymusise / ChatGLM-Tuning

hiyouga / ChatGLM-Efficient-Tuning

agentheroes / agentheroes

wenge-research / YAYI

predibase / lorax

PhoebusSi / Alpaca-CoT

liucongg / ChatGLM-Finetuning

adapter-hub / adapters

stochasticai / xTuring

dvlab-research / LongLoRA

absmach / supermq

markqvist / Reticulum

Nerogar / OneTrainer

ashishpatel26 / LLM-Finetuning

chenking2020 / FindTheChatGPTer

siliconflow / onediff

cyberman54 / ESP32-Paxcounter

ssbuild / chatglm_finetuning

brocaar / chirpstack-network-server