nlpyang

CodeGen

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

TextAttack

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

fast-transformers

Pytorch library for fast transformer implementations

the-pile

FLAN

state-spaces

Sequence Modeling with Structured State Spaces

Summarization-Papers

Summarization Papers

Adan

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

prize

A prize for finding tasks that cause large language models to show inverse scaling

unify-parameter-efficient-tuning

Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)

TransformerSum

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

Pytorch-PCGrad

Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"

booksum

UniEval

Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation

dialogsum

DialogSum: A Real-life Scenario Dialogue Summarization Dataset - Findings of ACL 2021

DialogLM

Official Implementation of "DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization."

REINA

Module-0

Module 0 - Fundamentals

LongDocSum

Code for NAACL 2021 full paper "Efficient Attentions for Long Document Summarization"

UniSumm

UNISUMM: Unified Few-shot Summarization with Multi-Task Pre-Training and Prefix-Tuning

MVLPT

code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720

ViS4mer

summary-explorer

Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.

marge

Code for ACL 21: Generating Query Focused Summaries from Query-Free Resources

light-transformer-emnlp2021

EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling

text-sum-uncertainty

Code for "Understanding Neural Abstractive Summarization Models via Uncertainty" (EMNLP20)

MACSum

Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.

RE-T5

Code and data for "Retrieval Enhanced Model for Commonsense Generation" (ACL-IJCNLP 2021).

NoisySumm

Codes for NAACL 2021 paper 'Noisy Self-Knowledge Distillation for Text Summarization'

SSN_DM