RulinShao

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

on-the-adversarial-robustness-of-visual-transformer

Code for the paper "On the Adversarial Robustness of Visual Transformers"

FastCkpt

Python package for rematerialization-aware gradient checkpointing

VL-Instruct

Codes for vision-language instruction tuning. Currently support BLIP2-t5 and BLIP2-vicuna.

Digital-Image-Processing

Llava-doremi

Automatic task-balancing for vision-language instruction tuning using group distributionally robust optimization (Group DRO, the technique used in Doremi)

AdversariallyRobustDistillation

Pytorch implementation of Adversarially Robust Distillation (ARD)

ALBEF

Code for ALBEF: a new vision-language pre-training method

bff

Large-scale deduplication & decontamination using bloom filters

denoised-smoothing

Provably defending pretrained classifiers including the Azure, Google, AWS, and Clarifai APIs

instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

NeMo

NeMo: a toolkit for conversational AI

Oscar

Oscar and VinVL

rag-evaluation-harness

Retrieval-augmented Generation (RAG) Evaluation Suite

RepGAN

Code base from StyleGAN2-ADA

RulinShao.github.io

open_lm

A repository for research on medium sized language models.

UWrc.github.io

The best research computing website in all the land.