Wuziyi616

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

flux

Official inference repo for FLUX.1 models

clip-as-service

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

segment-anything-2

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

progress

Linux tool to show progress for cp, mv, dd, ... (formerly known as cv)

AI-Scientist

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬

torchtitan

A native PyTorch Library for large model training

Lumina-T2X

Lumina-T2X is a unified framework for Text to Any Modality Generation

Latte

Latte: Latent Diffusion Transformer for Video Generation.

glomap

GLOMAP - Global Structured-from-Motion Revisited

yarn

YaRN: Efficient Context Window Extension of Large Language Models

LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

shape-of-motion

MINT-1T

MINT-1T: A one trillion token multimodal interleaved dataset.

diffusion-forcing

code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"

attention_with_linear_biases

Code for the ALiBi method for transformer language models (ICLR 2022)

ReconX

ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model

TransNetV2

TransNet V2: Shot Boundary Detection Neural Network

vfusion3d

[ECCV 2024] Code for VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Models

VisionLLaMA

VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks

MiraData

Official repo for paper "MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions"

rerope

Rectified Rotary Position Embeddings

unmasked_teacher

[ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models

DOVER

[ICCV 2023, Official Code] for paper "Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives". Official Weights and Demos provided.

Netflix-Prime-Auto-Skip

Automatically skip Ads, Intros, Recaps, Credits, etc. on Netflix, Prime video, Disney+ (Hotstar, STAR+), Crunchyroll and HBO max

PDVC

End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)

VidChapters

[NeurIPS 2023 D&B] VidChapters-7M: Video Chapters at Scale

rope-vit

[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"

flashattention2-custom-mask

Triton implementation of FlashAttention2 that adds Custom Masks.

VideoScore

official repo for "VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation" [EMNLP2024]