Nealcly

Explainable_GEC

The official code of the 2023 ACL paper "Enhancing Grammatical Error Correction Systems with Explanations"

WikiSQL

A large annotated semantic parsing corpus for developing natural language interfaces.

kg-2019

2019年百度的三元组抽取比赛，“科学空间队”源码

open-instruct

fairseq-detect-hallucination

Detect hallucinated tokens for conditional sequence generation.

disco-pointer

Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span Selection

ALCE

[EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627

TransformerPrograms

[NeurIPS 2023] Learning Transformer Programs

RRHF

[NIPS2023] RRHF & Wombat

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

prm800k

800,000 step-level correctness labels on LLM solutions to MATH problems

MAGE

FasterTransformer

Transformer related optimization, including BERT, GPT

safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

NaSGEC

Code & Data for our Paper "NaSGEC: Multi-Domain Chinese Grammatical Error Correction for Native Speaker Texts" (ACL 2023 Findings)

automated-interpretability

OpenAlpaca

OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA

lamini

instruction-datasets

All available datasets for Instruction Tuning of Large Language Models

Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

LLMZoo

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

GPT-4-LLM

Instruction Tuning with GPT-4

DeepSpeedExamples

Example models using DeepSpeed

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Document-MT-LLM

ParroT

The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1-mt) and human written translation and evaluation data.

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

ColossalAI

Making large AI models cheaper, faster and more accessible

MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。