MzeroMiko

ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

llama3

The official Meta Llama 3 GitHub site

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

pykan

Kolmogorov Arnold Networks

detr

End-to-End Object Detection with Transformers

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

LWM

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

scikit-image

Image processing in Python

taming-transformers

Taming Transformers for High-Resolution Image Synthesis

1Remote

One Remote Access Manager to Rule Them All

transformer-debugger

efficient-kan

An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).

torchscale

Foundation Architecture for (M)LLMs

torchtitan

A native PyTorch Library for large model training

MambaOut

MambaOut: Do We Really Need Mamba for Vision?

vq-vae-2-pytorch

Implementation of Generating Diverse High-Fidelity Images with VQ-VAE-2 in PyTorch

ThunderKittens

Tile primitives for speedy kernels

ViT-Adapter

[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions

WritingAIPaper

Writing AI Conference Papers: A Handbook for Beginners

mar

PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838

LLaVA-UHD

LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images

hi-ml

HI-ML toolbox for deep learning for medical imaging and Azure integration

infinibatch

Efficient, check-pointed data loading for deep learning with massive data sets.

SPO

Step-aware Preference Optimization: Aligning Preference with Denoising Performance at Each Step

vHeat

vHeat: Building Vision Models upon Heat Conduction

GrootVL

[NeurIPS2024 Spotlight] The official implementation of GrootVL: Tree Topology is All You Need in State Space Model

ControlCap

[ECCV 2024] ControlCap: Controllable Region-level Captioning

DynRefer

DynRefer: Delving into Region-level Multi-modality Tasks via Dynamic Resolution

VMamba_onnx

Export VMamba to onnx. VMamba: Visual State Space Models，code is based on VMamba: https://github.com/MzeroMiko/VMamba