cmhungsteve

LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

yolov9

Implementation of paper - YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

adapters

A Unified Library for Parameter-Efficient and Modular Transfer Learning

Vim

Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

LyCORIS

Lora beYond Conventional methods, Other Rank adaptation Implementations for Stable diffusion.

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fsdp_qlora

Training LLMs with QLoRA + FSDP

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

Mamba_State_Space_Model_Paper_List

[Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications

RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"

Awesome-Parameter-Efficient-Transfer-Learning

Collection of awesome parameter-efficient fine-tuning resources.

Awesome-Diffusion-Model-Based-Image-Editing-Methods

Diffusion Model-Based Image Editing: A Survey (arXiv)

DoRA

[ICML2024] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

TensorRT-Model-Optimizer

TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.

VILA

VILA - A multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

LITA

DoRA

Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"

mvtorch

a Pytorch library for multi-view 3D understanding and generation

merlin

Merlin: Empowering Multimodal LLMs with Foresight Minds

LeftRefill

LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Model (CVPR2024)

paper-template

ECCV 2024 paper template

Sports-QA

Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports

JORA

JORA: JAX Tensor-Parallel LoRA Library

VQscore

Image-Text-Co-Decomposition

PartDistill

DoRA-project-page

This is the project webpage of: DoRA: Weight-Decomposed Low-Rank Adaptation