duchenzhuang

freetype-py

Python binding for the freetype library

mistral-inference

Official inference library for Mistral models

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

icetk

A unified tokenization tool for Images, Chinese and English.

CogView2

official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"

enhancing-transformers

An unofficial implementation of both ViT-VQGAN and RQ-VAE in Pytorch

muse-maskgit-pytorch

Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

FSQ-pytorch

A Pytorch Implementation of Finite Scalar Quantization

Maskgit-pytorch

MaskGIT-pytorch

Pytorch implementation of MaskGIT: Masked Generative Image Transformer (https://arxiv.org/pdf/2202.04200.pdf)

GPT-4V-Act

AI agent using GPT-4V(ision) capable of using a mouse/keyboard to interact with web UI

pytorch-adversarial-training

PyTorch-1.0 implementation for the adversarial training on MNIST/CIFAR-10 and visualization on robustness classifier.

pytorch-cifar

95.47% on CIFAR10 with PyTorch

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

MakeMultiHeadNaive

Use naive MultiheadAttention implement to replace nn.MultiheadAttention in pytorch

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

imagen-pytorch

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

SFC

Semantic-Aware Fine-Grained Correspondence, at ECCV 2022 (Oral)

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

lynx-llm

paper: https://arxiv.org/abs/2307.02469 page: https://lynx-llm.github.io/

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

stable-diffusion

Latent Text-to-Image Diffusion

taming-transformers

Taming Transformers for High-Resolution Image Synthesis

ImageBind

ImageBind One Embedding Space to Bind Them All

ViP3D

Context-Cluster

[ICLR 2023 Oral] Image as Set of Points

scenic

Scenic: A Jax Library for Computer Vision Research and Beyond