qore-dl

BIG-Bench-Hard

Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them

BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

SimCSE-Pytorch

中文数据集下SimCSE+ESimCSE的实现

DecompositionFaithfulnessPaper

SimCSE

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

prontoqa

Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.

paws

This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification.

OCNLI

OCNLI: 中文原版自然语言推理任务

Chinese-English-NLI

In this program we inference the relation between two different languages.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

DeBERTa

The implementation of DeBERTa

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

self-attentive-parser

High-accuracy NLP parser with models for 11 languages.

factCC

Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper

ctc-gen-eval

EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation

CodeT

DiVeRSe

naacl-2021-fudge-controlled-generation

q-squared

BARTScore

BARTScore: Evaluating Generated Text as Text Generation

QuestEval

summac

Codebase, data and models for the SummaC paper in TACL

bert_score

BERT score for text generation

text-to-text-transfer-transformer

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

transformers_tasks

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.

automatic_prompt_engineer

gpt-prompt-engineer

awesome-gpt-prompt-engineering

A curated list of awesome resources, tools, and other shiny things for GPT prompt engineering.

Megatron-LLaMA

Best practice for training LLaMA models in Megatron-LM

DeepSpeedExamples

Example models using DeepSpeed