LiyuanLucasLiu

RAdam

On the Variance of the Adaptive Learning Rate and Beyond

LM-LSTM-CRF

Empower Sequence Labeling with Task-Aware Language Model

Transformer-Clinic

Understanding the Difficulty of Training Transformers

Torch-Scope

A Toolkit for Training, Tracking, Saving Models and Syncing Results

Vanilla_NER

Vanilla Sequence Labeling w. Char-LSTM-CRF

ArabicNER

Arabic NER system with a strong performance

clerk

ReinMax

Beyond Straight-Through

COVID-19-TweetIDs

The repository contains an ongoing collection of tweets IDs associated with the novel coronavirus COVID-19 (SARS-CoV-2), which commenced on January 28, 2020.

covid19_twitter

Covid-19 Twitter dataset for non-commercial research use and pre-processing scripts - under active development

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

pyahocorasick

Python module (C extension and plain python) implementing Aho-Corasick algorithm

APART

Overfitting or Underfitting? Understand Robustness Drop in Adversarial Training

Awesome-NAS

ColossalAI

Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training

Convex-Optimization-Course

Repository for my convex optimization course.

DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

emnlp-2020-virtual-conference-images

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

FasterTransformer

Transformer related optimization, including BERT, GPT

ipyplot

IPyPlot is a small python package offering fast and efficient plotting of images inside Jupyter Notebooks cells. It's using IPython with HTML for faster, richer and more interactive way of displaying big number of images.

manim

Animation engine for explanatory math videos

marian

Fast Neural Machine Translation in C++

megablocks

NLP-progress

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

NN-CUDA-Example

Several simple examples for popular neural network toolkits calling custom CUDA operators.

NREPapers

Must-read papers on neural relation extraction (NRE)

NvidiaRTX-LHRv2Unlocker

The first fully automated BIOS modifier for RTX cards with LHR v2 lock.

SciencePlots

Matplotlib styles for scientific plotting

spike2py

spike2py provides a simple interface to analyse and visualise data