xiaj1011

Megatron-LLaMA

Best practice for training LLaMA models in Megatron-LM

Llama-Chinese

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

AGIEval

OpenQA-eval

ACL 2023: Evaluating Open-Domain Question Answering in the Era of Large Language Models

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

LLMZoo

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

DeepSpeedExamples

Example models using DeepSpeed

transpeeder

train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

OpenChatKit

awesome-chatgpt

Curated list of awesome tools, demos, docs for ChatGPT and GPT-3

MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

PyChatGPT

⚡️ Python client for the unofficial ChatGPT API with auto token regeneration, conversation tracking, proxy support and more.

AESOP

Code for Aesop: Paraphrase Generation with Adaptive Syntactic Control (EMNLP 2021)

quality-controlled-paraphrase-generation

Quality Controlled Paraphrase Generation (ACL 2022)

cyac

High performance Trie and Ahocorasick automata (AC automata) Keyword Match & Replace Tool for python

AhoCorasickDoubleArrayTrie

An extremely fast implementation of Aho Corasick algorithm based on Double Array Trie.

CODER

CODER: Knowledge infused cross-lingual medical term embedding for term normalization. [JBI, ACL-BioNLP 2022]

BERT-NER-Pytorch

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

Snorkel-NER

Named Entity Recognition using Snorkel

pyahocorasick

Python module (C extension and plain python) implementing Aho-Corasick algorithm

awesome-knowledge-graph

整理知识图谱相关学习资料

NLP_ability

总结梳理自然语言处理工程师(NLP)需要积累的各方面知识，包括面试题，各种基础知识，工程能力等等，提升核心竞争力

CCKS2019-CKBQA

A system for CCKS2019-CKBQA, whose single system reach 0.69 and ensemble system reach 0.73

ccks2019-ckbqa-4th-codes

中文知识库问答代码，CCKS2019 CKBQA评测第四名解决方案

DeepEventMine

DeepEventMine: End-to-end Neural Nested Event Extraction from Biomedical Texts

GEANet-BioMed-Event-Extraction

Code for the paper Biomedical Event Extraction with Hierarchical Knowledge Graphs