liury889

mmpose

OpenMMLab Pose Estimation Toolbox and Benchmark.

LLM101n

LLM101n: Let's build a Storyteller

ChatDev

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

XAgent

An Autonomous LLM Agent for Complex Task Solving

tutorials

PyTorch tutorials.

llama3

The official Meta Llama 3 GitHub site

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

FunASR

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

awesome-multi-agent-papers

A compilation of the best multi-agent papers

HolmesVAD

Official implementation of "Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLM"

LocLLM

Code for "LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model", CVPR 2024 Highlight

Qwen-VL

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

Pink

Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs

MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

translation-agent

marker

Convert PDF to markdown quickly with high accuracy

anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

CogVLM2

GPT4V-level open-source multi-modal model based on Llama3-8B

dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

LWM

MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models

GroundingGPT

[ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model

Chat-UniVi

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

Video-LLaVA

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

grok-1

Grok open release

VideoCrafter

VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models