lora

There are 53 repositories under lora topic.

LLaMA-Factory
hiyouga / LLaMA-Factory
A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
agent ai chatglm fine-tuning gpt instruction-tuning language-model large-language-models llama llama3 llm lora mistral moe peft qlora quantization qwen rlhf transformers
Language:Python 27348
Chinese-LLaMA-Alpaca
ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llm plm pre-trained-language-models alpaca llama nlp quantization large-language-models lora alpaca-2 llama-2
Language:Python 17953
camenduru / stable-diffusion-webui-colab
stable diffusion webui colab
ai ai-art colab colab-notebook colaboratory deep-learning dreambooth gradio image-generation img2img lora pytorch stable-diffusion stable-diffusion-web-ui stable-diffusion-webui t2v text2video texttovideo txt2img
Language:Jupyter Notebook 15489
huggingface / peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
adapter diffusion llm lora parameter-efficient-learning python pytorch transformers
Language:Python 15128
unslothai / unsloth
Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
ai fine-tuning finetuning gemma llama llama3 llms lora mistral phi3 qlora
Language:Python 12908
microsoft / LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
adaptation deberta deep-learning gpt-2 gpt-3 language-model lora low-rank pytorch roberta
Language:Python 9865
LianjiaTech / BELLE
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
bloom instruction-set llama open-models gpt-q instruct-gpt gpt-evaluation chinese-nlp lora instruct-finetune
Language:HTML 7735
cloneofsimo / lora
Using Low-rank adaptation to quickly fine-tune diffusion models.
diffusion dreambooth fine-tuning lora stable-diffusion
Language:Jupyter Notebook 6822
datawhalechina / self-llm
《开源大模型食用指南》基于Linux环境快速部署开源大模型，更适合**宝宝的部署教程
chatglm chatglm3 gemma-2b-it glm-4 internlm2 llama3 llm lora minicpm q-wen qwen qwen1-5 qwen2
Language:Jupyter Notebook 6603
yangjianxin1 / Firefly
Firefly: 大模型训练工具，支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
alpaca aquila baichuan chatglm gemma gpt internlm llama llama2 llama3 llm lora minicpm mistral mixtral peft qlora qwen qwen2 zephyr
Language:Python 5314
Akegarasu / lora-scripts
LoRA & Dreambooth training scripts & GUI use kohya-ss's trainer, for diffusion model.
dreambooth finetune lora
Language:Python 4132
mymusise / ChatGLM-Tuning
基于ChatGLM-6B + LoRA的Fintune方案
chatglm chatgpt lora peft
Language:Python 3711
hiyouga / ChatGLM-Efficient-Tuning
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
alpaca chatglm chatglm2 chatgpt fine-tuning huggingface language-model lora peft pytorch qlora rlhf transformers
Language:Python 3639
OpenMQTTGateway
1technophile / OpenMQTTGateway
MQTT gateway for ESP8266 or ESP32 with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermometer compatibility & LoRa.
arduino arduino-uno ble ble-beacons bridge esp32 esp8266 gateway home-assistant home-automation lora miflora mqtt nodemcu openhab2 platformio rcswitch wemos-d1 xiaomi
Language:C++ 3513
lyogavin / Anima
33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
chinese-nlp finetune generative-ai instruct-gpt instruction-set llama llm lora open-models open-source open-source-models qlora chinese-llm
Language:Jupyter Notebook 3498
ExpressLRS / ExpressLRS
STM32/ESP32/ESP8285-based High-Performance Radio Link for RC applications
rc lora esp8266 esp32 fpv quadcopter remote-control sx1280 sx1276 drone stm32
Language:C++ 3428
wenge-research / YAYI
雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型，由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)
bloom chat chinese llama llama2 llm lora yayi
Language:Python 3245
meshtastic / firmware
Meshtastic device firmware
gps lora hiking ttgo-tbeam heltec meshtastic ttgo esp32 nrf52 mesh-networks off-grid mesh pico rp2040 stm32
Language:C++ 3037
liucongg / ChatGLM-Finetuning
基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等
chatglm chatgpt freeze lora p-tuning chatglm2 chatglm3
Language:Python 2581
stochasticai / xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
deep-learning fine-tuning gpt-2 gpt-j llama llm lora language-model alpaca finetuning adapter gen-ai generative-ai mistral mixed-precision peft quantization
Language:Python 2566
dvlab-research / LongLoRA
Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
fine-tuning-llm large-language-models long-context llm lora
Language:Python 2559
PhoebusSi / Alpaca-CoT
We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！
alpaca chatglm chatgpt cot instruction-tuning llama llm lora moss p-tuning parameter-efficient pytorch tabul tabular-data tabular-model
Language:Jupyter Notebook 2527
modelscope / swift
ms-swift: Use PEFT or Full-parameter to finetune 300+ LLMs or 50+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3, Llava-Video, Internvl2, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)
agent awq deploy dpo glm4 internvl llama llama3 llava llm lora mistral-nemo modelscope multimodal ollama peft pre-training qwen2 sft unsloth
Language:Python 2477
adapter-hub / adapters
A Unified Library for Parameter-Efficient and Modular Transfer Learning
adapters bert lora natural-language-processing nlp parameter-efficient-learning parameter-efficient-tuning pytorch transformers
Language:Jupyter Notebook 2476
absmach / magistrala
Industrial IoT Messaging and Device Management Platform
coap distributed-systems edge edge-computing golang iiot internet-of-things iot iot-cloud iot-gateway iot-platform lora lorawan lwm2m message-broker messaging mqtt opc-ua telecom web-socket
Language:Go 2437
chenking2020 / FindTheChatGPTer
ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利
agi alpaca autogpt baichuan belle ceval chatglm chatgpt codi guanaco learderboard linly llama llama2 llava lora minigpt4 self-instruct vicuna wizadlm
2014
predibase / lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers
Language:Python 1932
ashishpatel26 / LLM-Finetuning
LLM Finetuning with peft
falcon fine-tuning huggingface llama llama2 llm llms lora peft pytorch text-generation
Language:Jupyter Notebook 1913
cyberman54 / ESP32-Paxcounter
Wifi & BLE driven passenger flow metering with cheap ESP32 boards
wifi ttgo lopy heltec ttn lorawan lora thethingsnetwork esp32 platformio macaddr bme680 gps gps-tracker pycom arduino dcf77 helium-network iot mqtt
Language:C++ 1700
markqvist / Reticulum
The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.
networking-stack packet-radio lora mesh-networks reticulum rns mesh network
Language:Python 1623
ssbuild / chatglm_finetuning
chatglm 6b finetuning and alpaca finetuning
adalora chatglm deep-learning freeze ia3 lora p-tuning-v2 pytorch qlora sft
Language:Python 1530
brocaar / chirpstack-network-server
ChirpStack Network Server is an open-source LoRaWAN network-server.
internet-of-things iot lora lora-server loraserver lorawan network-server
Language:Go 1488
onediff
siliconflow / onediff
OneDiff: An out-of-the-box acceleration library for diffusion models.
aigc-serving comfyui comfyui-workflow cuda diffusers diffusion-models inference-engine lcm lcm-lora lora performance-optimization pytorch sd-webui sdxl sdxl-turbo stable-diffusion stable-video-diffusion
Language:Python 1469
OneTrainer
Nerogar / OneTrainer
OneTrainer is a one-stop solution for all your stable diffusion training needs.
fine-tuning lora stable-diffusion training
Language:Python 1437
whitecatboard / Lua-RTOS-ESP32
Lua RTOS for ESP32
esp32 espressif freertos iot iot-platform lora lorawan lua lua-rtos rtos
Language:C 1180
zjunlp / KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
llama large-language-models pre-trained-language-models language-model instruction-following deep-learning chinese english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training bilingual pre-trained-model knowlm instructie
Language:Python 1134

lora

hiyouga / LLaMA-Factory

ymcui / Chinese-LLaMA-Alpaca

camenduru / stable-diffusion-webui-colab

huggingface / peft

unslothai / unsloth

microsoft / LoRA

LianjiaTech / BELLE

cloneofsimo / lora

datawhalechina / self-llm

yangjianxin1 / Firefly

Akegarasu / lora-scripts

mymusise / ChatGLM-Tuning

hiyouga / ChatGLM-Efficient-Tuning

1technophile / OpenMQTTGateway

lyogavin / Anima

ExpressLRS / ExpressLRS

wenge-research / YAYI

meshtastic / firmware

liucongg / ChatGLM-Finetuning

stochasticai / xTuring

dvlab-research / LongLoRA

PhoebusSi / Alpaca-CoT

modelscope / swift

adapter-hub / adapters

absmach / magistrala

chenking2020 / FindTheChatGPTer

predibase / lorax

ashishpatel26 / LLM-Finetuning

cyberman54 / ESP32-Paxcounter

markqvist / Reticulum

ssbuild / chatglm_finetuning

brocaar / chirpstack-network-server

siliconflow / onediff

Nerogar / OneTrainer

whitecatboard / Lua-RTOS-ESP32

zjunlp / KnowLM