mixiao-ai

cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的可商用开源多模态对话模型

Monkey

【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models

LLaMA-VID

Official Implementation for LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

AnomalyGPT

[AAAI 2024 Oral] AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models

industrial-surface-inspection-datasets

Datasets for industrial surface-inspection

CogVLM2

GPT4V-level open-source multi-modal model based on Llama3-8B

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

autodistill

Images to inference with no labeling (use foundation models to train supervised models).

VLM_survey

Collection of AWESOME vision-language models for vision tasks

trl

Train transformer language models with reinforcement learning.

DeepSeek-VL

DeepSeek-VL: Towards Real-World Vision-Language Understanding

Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

open_clip

An open source implementation of CLIP.

MAP-NEO

LLaVA-NeXT

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Qwen-VL

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

T-Rex

[ECCV2024] API code for T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy

FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

Personalize-SAM

Personalize Segment Anything Model (SAM) with 1 shot in 10 seconds

lang-segment-anything

SAM with text prompt

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

TensorRT-For-YOLO-Series

tensorrt for yolo series (YOLOv10,YOLOv9,YOLOv8,YOLOv7,YOLOv6,YOLOX,YOLOv5), nms plugin support

YOLOv8-TensorRT

YOLOv8 using TensorRT accelerate !