sIncerass

powernorm

[ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845

MVLPT

code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720

prag_generation

[NAACL 2019] code for "Pragmatically Informative Text Generation" https://arxiv.org/abs/1904.01301

ELSA

[WWW 2019] code for "Emoji-Powered Representation Learning for Cross-Lingual Sentiment Classification" https://arxiv.org/abs/1806.02557

QBERT

one_layer_lottery_ticket

[EMNLP 2021] code for "What’s Hidden in a One-layer Randomly Weighted Transformer?"

bottom-up-summary

Data-diff

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

few-shot-learning

Few-shot Learning of GPT-3

google-drive-downloader

Minimal class to download shared files from Google Drive.

java-nlp-toolkit

My personal Java NLP toolkit that serves as an interface to various existing NLP libraries.

Megatron-LM

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Mr_Right

Nested-NER

nums

A library that translates Python and NumPy to optimized distributed systems code.

PreSumm

code for EMNLP 2019 paper Text Summarization with Pretrained Encoders

promptsource

Toolkit for collecting and applying templates of prompting instances

riscv-simulator

sincerass.github.io

Sheng (Arnold) Shen's homepage

sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

The-compression-of-Transformer

transformers

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs