pengchengu

Video-Motion-Customization

VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models (CVPR 2024)

VBench

[CVPR2024 Highlight] VBench: Comprehensive Benchmark Suite for Video Generative Models

Vlogger

[CVPR2024] Make Your Dream A Vlog

mergekit

Tools for merging pretrained large language models.

torchdynamo

A Python-level JIT compiler designed to make unmodified PyTorch programs faster.

evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

mistral-src

Reference implementation of Mistral AI 7B v0.1 model.

Chinese-Mixtral-8x7B

中文Mixtral-8x7B（Chinese-Mixtral-8x7B）

megablocks

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

grok-1

Grok open release

composer

Supercharge Your Model Training

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

RepViT

RepViT: Revisiting Mobile CNN From ViT Perspective [CVPR 2024] and RepViT-SAM: Towards Real-Time Segmenting Anything

openai-cookbook

Examples and guides for using the OpenAI API

OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

multimodal

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.

mmagic

OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.

Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

Gemini-API

The unofficial python package that returns response of Google Gemini through cookie values.

Bard-API

The unofficial python package that returns response of Google Bard through cookie value.

CVPR2024-Papers-with-Code

CVPR 2024 论文和开源项目合集

SiT

Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"

GEMMA

Genome-wide Efficient Mixed Model Association

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

plip

Pathology Language and Image Pre-Training (PLIP) is the first vision and language foundation model for Pathology AI (Nature Medicine). PLIP is a large-scale pre-trained model that can be used to extract visual and language features from pathology images and text description. The model is a fine-tuned version of the original CLIP model.

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

fastserve-ai

Machine Learning Serving focused on GenAI with simplicity as the top priority.