Yuuraa

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

mem0

The Memory layer for your AI apps

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

segment-anything-2

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

RAG_Techniques

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.

Voyager

An Open-Ended Embodied Agent with Large Language Models

anthropic-cookbook

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

agentscope

Start building LLM-empowered multi-agent applications in an easier way.

MeloTTS

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

RouteLLM

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Awesome-LLMs-for-Video-Understanding

🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

MetaCLIP

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

awesome-instruction-dataset

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

Everything-LLMs-And-Robotics

The world's largest GitHub Repository for LLMs + Robotics

ALLaVA

Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model

BIKE

【CVPR'2023】Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models

LLaVA-Hound-DPO

VindLU

vlm-rlaif

ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback

ECCV2024_MBS

[ECCV2024] Mitigating Background Shift in Class-Incremental Semantic Segmentation

Pseudo-RIS

[ECCV 2024] Official code for "Pseudo-RIS: Distinctive Pseudo-supervision Generation for Referring Image Segmentation"

srt

i-SRT:Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective Judgement