truemanstock

kbvqa-public

VQA2.0-Recent-Approachs-2018.pytorch

A pytroch reimplementation of "Bilinear Attention Network", "Intra- and Inter-modality Attention", "Learning Conditioned Graph Structures", "Learning to count object", "Bottom-up top-down" for Visual Question Answering 2.0

vqa.pytorch

Visual Question Answering in Pytorch

open_clip

An open source implementation of CLIP.

EgoCOT_Dataset

toolformer

JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"

visprog

Official code for VisProg (CVPR 2023 Best Paper!)

RT-2

Democratization of RT-2 "RT-2: New model translates vision and language into action"

InstructBLIP-demo

emacs-window-manager

Customizable window manager for emacs

MIC

MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU

SayCan

Implementation of "Do As I Can, Not As I Say: Grounding Language in Robotic Affordances" by Google

LLM-Planner

[ICCV'23] LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models

LLM-Planning-Papers

Must-read Papers on Large Language Model (LLM) Planning.

taskography

Task planning over 3D scene graphs

sayplan.github.io

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

PCA-EVAL

[ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain

habitat-lab

A modular high-level library to train embodied AI agents across a variety of tasks and environments.

AgentGPT

🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

Auto-GPT

An experimental open-source attempt to make GPT-4 fully autonomous.

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

DriveDreamer

[ECCV 2024] DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving

dynalang

Code for "Learning to Model the World with Language." ICML 2024 Oral.

jepa

PyTorch code and models for V-JEPA self-supervised learning from video.

WorldModels

Full World Models Implementation in Chainer

WorldModels

World Models with TensorFlow 2

WorldModels

An implementation of the ideas from this paper https://arxiv.org/pdf/1803.10122.pdf