siddk

voltron-robotics

Voltron: Language-Driven Representation Learning for Robotics

vqa-outliers

Code and Experiments for ACL-IJCNLP 2021 Paper "Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering."

npi

Neural Programmer-Interpreter Implementation (Reed, de Freitas: https://arxiv.org/abs/1511.06279), in Tensorflow

voltron-evaluation

Voltron Evaluation: Diverse Evaluation Tasks for Robotic Representation Learning

lila

Code & Experiments for "LILA: Language-Informed Latent Actions" to be presented at the Conference on Robot Learning (CoRL) 2021.

annotated-butd

Bottom-Up Top-Down Attention for VQA Implementation accompanying Annotated BUTD Blog Post

kindling

Template Repository with Conda and Sane Quality Defaults (Black, Flake, isort) for PyTorch Projects.

mnist-vae-scaling

Tutorial Repository with a minimal example for showing how to deploy training across various compute infrastructure.

mjolnir

Template Repository with Conda and Sane Quality Defaults (Black, Flake, isort) for PyTorch-Lightning Projects.

siddk.github.io

My personal website.

c3po

R2D2 Core Content Management and Cleaning Repository for Post-Processing and Organization

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

afl-other-arch

AFL, with scripts to support other architectures.

driller-afl

A version of AFL tailored for Driller's use in analyzing CGC binaries.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

metaworld

An open source robotics benchmark for meta- and multi-task reinforcement learning

mistral

Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging Face 🤗 Transformers.

mnist-skeleton

Skeleton Repository implementing a simple MNIST example for new workflow --> PyTorch Lightning + Weights & Biases

open_flamingo

An open-source framework for training large multimodal models.

prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)

R2D2

Residential Robot Demonstration Dataset

r3m

Pre-training Reusable Representations for Robotic Manipulation Using Diverse Human Video Data

refdb

Stores paper references, outputs to bib/html, does basic sanity checking on bib entries

rl-kitchen-sink

PyTorch Implementations of Standard Deep RL Algorithms (including REINFORCE, A2C, PPO)

robo-lambda

Simple Robotics Demo/Tutorial for P-Lambda Meeting 8/6/21

robohive-voltron

Robohive Fork with Reproducible Evaluations defined in Voltron: Language-Driven Representation Learning for Robotics.

sail-blog

The SAIL blog

tesseract

Collection of Singularity Definition Files and .sif Images for Reproducibility.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

vs-kpts