StOnEGiggity

alfred

ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks

allenact

An open source framework for research in Embodied-AI from AI2.

Awesome-Imitation-Learning

A curated list of awesome imitation learning resources and publications

Awesome-NAS

A curated list of neural architecture search (NAS) resources.

CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

collaborative-experts

Video embeddings for retrieval with natural language queries

dg_util

Files that I find useful in my projects.

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

gprof2dot

Converts profiling output to a dot graph.

habitat-api-1

A modular high-level library to train embodied AI agents across a variety of tasks, environments, and simulators.

habitat-challenge

Code for the habitat challenge

HouseNavAgent

Navigation agent with Bayesian relational memory in the House3D environment

Matterport3DSimulator

AI Research Platform for Reinforcement Learning from Real Panoramic Images.

Navigation-paperlist

Neural-SLAM

Pytorch code for ICLR-20 Paper "Learning to Explore using Active Neural SLAM"

OccupancyAnticipation

This repository contains code for our publication "Occupancy Anticipation for Efficient Exploration and Navigation" in ECCV 2020.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

pytorch-grad-cam

PyTorch implementation of Grad-CAM

pytorch-gradual-warmup-lr

Gradually-Warmup Learning Rate Scheduler for PyTorch

SC-SfMLearner-Release-1

Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Video (NeurIPS 2019)

self-mono-sf

Self-Supervised Monocular Scene Flow Estimation (CVPR 2020)

splitnet-1

Code for SplitNet paper

Swin-Transformer-Semantic-Segmentation

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Semantic Segmentation.

TCL

code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022

torchinterp1d

1D interpolation for pytorch

Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

ts2_net

vision

Datasets, Transforms and Models specific to Computer Vision

VLN-CE

Vision-and-Language Navigation in Continuous Environments using Habitat