ZCMax

openvla

OpenVLA: An open-source vision-language-action model for robotic manipulation.

acad-homepage.github.io

AcadHomepage: A Modern and Responsive Academic Personal Homepage

conv-llava

gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

NS3D

LLaVA-NeXT

behavior-vision-suite.github.io

ml-visuals

🎨 ML Visuals contains figures and templates which you can reuse and customize to improve your scientific writing.

Stratified-Transformer

Stratified Transformer for 3D Point Cloud Segmentation (CVPR 2022)

rerun

Visualize streams of multimodal data. Fast, easy to use, and simple to integrate. Built in Rust using egui.

PLLaVA

Official repository for the paper PLLaVA

LLaVA-pp

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

omnidata

A Scalable Pipeline for Making Steerable Multi-Task Mid-Level Vision Datasets from 3D Scans [ICCV 2021]

GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

3D-VLA

[ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model

llama3

The official Meta Llama 3 GitHub site

probe3d

[CVPR 2024] Probing the 3D Awareness of Visual Foundation Models

ml-ferret

open-eqa

OpenEQA Embodied Question Answering in the Era of Foundation Models

SceneVerse

Awesome-LLMs-for-Video-Understanding

🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

VQASynth

Compose multimodal datasets 🎹

multi_token

Embed arbitrary modalities (images, audio, documents, etc) into large language models.

Chat-UniVi

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 50+ HF models, 20+ benchmarks

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

act3d-chained-diffuser

A unified architecture for multimodal multi-task robotic policy learning.