myleott

infinibatch

Efficient, check-pointed data loading for deep learning with massive data sets.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

evaluation-of-nmt-bt

This repository contains additional reference translations for the WMT'14 En-De (newstest2014) and WMT'19 En-Ru (newstest2019) test sets as described in the paper: "On The Evaluation of Machine Translation Systems Trained With Back-Translation" https://arxiv.org/abs/1908.05204

gpt-3

GPT-3: Language Models are Few-Shot Learners

stochastic_gradient_push

Stochastic Gradient Push for Distributed Deep Learning

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

torchgpipe

A GPipe implementation in PyTorch

scitldr

pubmed_parser

:clipboard: A Python Parser for PubMed Open-Access XML Subset and MEDLINE XML Dataset

BLUE_Benchmark

BLUE benchmark consists of five different biomedicine text-mining tasks with ten corpora.

electra

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

pytorch-OpCounter

Count the MACs / FLOPs of your PyTorch model.

faiss

A library for efficient similarity search and clustering of dense vectors.

flipy

A Python linear programming interface library

xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)

espresso

Espresso: A Fast End-to-End Neural Speech Recognition Toolkit

umberto

UmBERTo: an Italian Language Model trained with Whole Word Masking.

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

inflect

Correctly generate plurals, ordinals, indefinite articles; convert numbers to words

JuICe

Code for generating the JuICe dataset.

vizseq

An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)

ClassyVision

An end-to-end PyTorch framework for image and video classification

hydra

Hydra is a framework for elegantly configuring complex applications

cc_net

Tools to download and cleanup Common Crawl data

MASS

MASS: Masked Sequence to Sequence Pre-training for Language Generation

RAdam

On the Variance of the Adaptive Learning Rate and Beyond

fastBPE

Fast BPE

ELI5

Scripts and links to recreate the ELI5 dataset.

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.