nyyznyyz1991

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Chinese-CLIP

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

scaling-laws-openclip

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)

Baichuan-13B

A 13B large language model developed by Baichuan Intelligent Technology

yuren-baichuan-7b

基于baichuan-7b的开源多模态大语言模型

summarize-from-feedback

Code for "Learning to summarize from human feedback"

EdgeGPT

Reverse engineered API of Microsoft's Bing Chat AI

conceptual-12m

Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

mPLUG-Owl

mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

Multimodal-GPT

Multimodal-GPT

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

llama

Inference code for Llama models

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

BLIP

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

TaskMatrix

x-deeplearning

An industrial deep learning framework for high-dimension sparse data

MVKE

SIGKDD'2022: Mixture of Virtual-Kernel Experts for Multi-Objective User Profile Modeling

KGFlex

Official implementation of the paper "Sparse Feature Factorization for Recommender Systems with Knowledge Graphs"

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

VL-T5

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)

mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

fastmoe

A fast MoE impl for PyTorch

R2D2

GroupViT

Official PyTorch implementation of GroupViT: Semantic Segmentation Emerges from Text Supervision, CVPR 2022.