ZexinLi0w0

LOOK-M

Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference"

SVD-LLM

Official Code for "SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression"

parallel-decoding

Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"

Distributed-DRL

Distributed Deep Reinforcement Learning

llama-moe

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

pytorch-attention

🦖Pytorch implementation of popular Attention Mechanisms, Vision Transformers, MLP-Like models and CNNs.🔥🔥🔥

SoraReview

The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models".

online-continual-learning

A collection of online continual learning paper implementations and tricks for computer vision in PyTorch, including our ASER(AAAI-21), SCR(CVPR21-W) and an online continual learning survey (Neurocomputing).

Awesome-Efficient-LLM

A curated list for Efficient Large Language Models

torchsnapshot

A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind.

RealtimeOCL

continual-learning-baselines

Continual learning baselines and strategies from popular papers, using Avalanche. We include EWC, SI, GEM, AGEM, LwF, iCarl, GDumb, and other strategies.

Embedded-CL

PyTorch code for our CoLLAs-2022 paper "Online Continual Learning for Embedded Devices"

cleanlab

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

White-box-and-black-box-attacks-on-deep-learning-visual-models

A project to implement white-box and black-box attacks on deep learning visual models

MIMO-pytorch

PyTorch Implementation of MIMO (ICLR 2021)

e2e-learning-self-driving-cars

🚗 𝖀𝖓𝖔𝖋𝖋𝖎𝖈𝖎𝖆𝖑 PyTorch implementation of "End-to-End Learning for Self-Driving Cars" (arXiv:1604.07316) with Udacity's Simulator

BMTools

Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins

flash-linear-attention

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

avalanche

Avalanche: an End-to-End Library for Continual Learning based on PyTorch.

CLDatasets

BudgetCL

Code for CVPR paper: Computationally Budgeted Continual Learning: What Does Matter?

rtrl

PyTorch implementation of our paper Real-Time Reinforcement Learning (NeurIPS 2019)

TripleNet

TripleNet Image Classification on CIFAR-10 by raspberrypi

MeZO

[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333

CVPR-2023-24-Papers

CVPR 2023-2024 Papers: Dive into advanced research presented at the leading computer vision conference. Keep up to date with the latest developments in computer vision and deep learning. Code included. ⭐ support visual intelligence development!

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

stick

:innocent: A PyTorch-like deep learning framework. Just for fun.

xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more