ZhenhuaZJim

glim

GLIM: versatile and extensible range-based 3D localization and mapping framework

GRUtopia

GRUtopia: Dream General Robots in a City at Scale

dclm

DataComp for Language Models

open_x_embodiment

lang-segment-anything

SAM with text prompt

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Segment-Everything-Everywhere-All-At-Once

[NeurIPS 2023] Official implementation of the paper "Segment Everything Everywhere All at Once"

detrex

detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.

T-Rex

[ECCV2024] API code for T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy

DINOv

[CVPR 2024] Official implementation of the paper "Visual In-context Learning"

Quadruped-PyMPC

A model predictive controller for quadruped robots based on the single rigid body model and written in python. Gradient-based (acados) or Sampling-based (jax).

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的可商用开源多模态对话模型

openmask3d

recognize-anything

Open-source and strong foundation image recognition models.

CLIP_prefix_caption

Simple image captioning model

omnimotion

masa

Official Implementation of CVPR24 highligt paper: Matching Anything by Segmenting Anything

yolov10

YOLOv10: Real-Time End-to-End Object Detection

ultralytics

NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite

llama3

The official Meta Llama 3 GitHub site

lerobot

🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch

searchformer

Official codebase for the paper "Beyond A* Better Planning with Transformers via Search Dynamics Bootstrapping".

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

Depth-Anything

[CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

LanguageAgentTreeSearch

[ICML 2024] Official repository for "Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models"

mistral-inference

Official inference library for Mistral models

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap