Frankluox

GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

ChatTTS

A generative speech model for daily dialogue.

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

axolotl

Go ahead and axolotl questions

Omost

Your image is almost there!

lerobot

🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch

MiniCPM

MiniCPM-2B: An end-side LLM outperforming Llama2-13B.

mergekit

Tools for merging pretrained large language models.

schedule_free

Schedule-Free Optimization in PyTorch

penzai

A JAX research toolkit for building, editing, and visualizing neural networks.

dora

DORA (Dataflow-Oriented Robotic Application) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.

mujoco_menagerie

A collection of high-quality models for the MuJoCo physics engine, curated by Google DeepMind.

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4 💯

PufferLib

Simplifying reinforcement learning for complex game environments

Grounding-DINO-1.5-API

API for Grounding DINO 1.5: IDEA Research's Most Capable Open-World Object Detection Model Series

loco-mujoco

Imitation learning benchmark focusing on complex locomotion tasks using MuJoCo.

Pandora

Pandora: Towards General World Model with Natural Language Actions and Video States

TeleVision

Open-TeleVision: Teleoperation with Immersive Active Visual Feedback

Glyph-ByT5

[ECCV2024] This is an official inference code of the paper "Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering" and "Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Rendering""

robocasa

RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots

GRUtopia

GRUtopia: Dream General Robots in a City at Scale

starcoder2-self-align

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

CV-VAE

CV-VAE: A Compatible Video VAE for Latent Generative Video Models

VADER

Video Diffusion Alignment via Reward Gradients. We improve a variety of video diffusion models such as VideoCrafter, OpenSora, ModelScope and StableVideoDiffusion by finetuning them using various reward models such as HPS, PickScore, VideoMAE, VJEPA, YOLO, Aesthetics etc.

awesome-robot-learning-envs

A list of awesome and popular robot learning environments

android_world

AndroidWorld is an environment and benchmark for autonomous agents

MorphTokens

MATH-V

MATH-Vision dataset and code to measure Multimodal Mathematical Reasoning capabilities.