whai362

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.

IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.

chatgpt-prompts-for-academic-writing

This list of writing prompts covers a range of topics and tasks, including brainstorming research ideas, improving language and style, conducting literature reviews, and developing research plans.

T-Rex

T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy

InternLM-XComposer

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.

Emu

Emu Series: Generative Multimodal Models from BAAI

Monkey

【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models

MaskDINO

[CVPR 2023] Official implementation of the paper "Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation"

open-instruct

automatic_prompt_engineer

draw-fast

InternVL

[CVPR 2024 Oral] InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks —— An Open-Source Alternative to ViT-22B

UniRepLKNet

[CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition

SAM-Med2D

Official implementation of SAM-Med2D

AlphaCLIP

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

InterFuser

[CoRL 2022] InterFuser: Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer

APE

[CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception

all-seeing

[ICLR 2024] This is the official implementation of the paper "The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World"

crafter

Benchmarking the Spectrum of Agent Capabilities

DCNv4

[CVPR 2024] Deformable Convolution v4

DCI-VTON-Virtual-Try-On

[ACM Multimedia 2023] Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flow.

Mini-DALLE3

Mini-DALLE3: Interactive Text to Image by Prompting Large Language Models

MultimodalOCR

On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)

UniPose

Official implementation of the paper "UniPose : Detecting Any Keypoints"

Vision-RWKV

Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures

ControlLLM

ControlLLM: Augment Language Models with Tools by Searching on Graphs

HIMLoco

[ICLR 2024] Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response

StyleRF

[CVPR 2023] StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields

AVSegFormer

[AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer