chinese-nlp

There are 97 repositories under chinese-nlp topic.

pwxcoo / chinese-xinhua
:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。
data scraper chinese-traditional python3 chinese chinese-characters chinese-nlp chinese-language chinese-simplified json-dataset json json-data
Language:Python 11380
brightmart / nlp_chinese_corpus
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
chinese-dataset chinese-corpus pretrain word2vec nlp bert language-model wiki news question-answering chinese corpus chinese-nlp dataset text-classification
9805
LianjiaTech / BELLE
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
bloom chinese-nlp gpt-evaluation gpt-q instruct-finetune instruct-gpt instruction-set llama lora open-models
Language:HTML 8260
crownpku / Awesome-Chinese-NLP
A curated list of resources for Chinese NLP 中文自然语言处理相关资料
chinese-nlp nlp
7916
lyogavin / airllm
AirLLM 70B inference with single 4GB GPU
chinese-llm chinese-nlp finetune generative-ai instruct-gpt instruction-set llama llm lora open-models open-source open-source-models qlora
Language:Jupyter Notebook 6315
HIT-SCIR / ltp
Language Technology Platform
chinese-nlp machine-learning natural-language-processing nlp
Language:Python 5202
Fengshenbang-LM
IDEA-CCNL / Fengshenbang-LM
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。
aigc chinese-nlp distributed-training multimodal pretrained-models pytorch transformers
Language:Python 4150
esbatmop / MNBVC
MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
chinese chinese-language chinese-nlp chinese-simplified corpus-data nlp nlp-machine-learning
4021
baidu / lac
百度NLP：分词，词性标注，命名实体识别，词重要性
word-segmentation part-of-speech-tagger named-entity-recognition chinese-word-segmentation chinese-nlp lexical-analysis python java
Language:C++ 3973
fastnlp / fastNLP
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
chinese-nlp deep-learning natural-language-processing nlp-library nlp-parsing text-classification text-processing
Language:Python 3142
CVI-SZU / Linly
Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
bert gpt-3 language-model llama nlp zero-shot-learning chatbot chatgpt chinese chinese-nlp
Language:Python 3056
crownpku / Information-Extraction-Chinese
Chinese Named Entity Recognition with IDCNN/biLSTM+CRF, and Relation Extraction with biGRU+2ATT 中文实体识别与关系提取
chinese-nlp information-extraction named-entity-recognition nlp relation-extraction
Language:Python 2266
thunlp / THULAC-Python
An Efficient Lexical Analyzer for Chinese
chinese-nlp
Language:Python 2087
didi / ChineseNLP
Datasets, SOTA results of every fields of Chinese NLP
chinese-nlp chinese-word-segmentation entity-linking machine-translation nlp nlp-tasks question-answering
Language:HTML 1806
HIT-SCIR / pyltp
pyltp: the python extension for LTP
chinese-nlp python
Language:C++ 1554
baidu / DDParser
百度开源的依存句法分析系统
dependency-parser chinese-nlp python chinese-dependency-parser dependency-parsing syntax-parser
Language:Python 998
lionsoul2014 / jcseg
Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction implemented based on TEXTRANK algorithm. Jcseg had a build-in http server and search modules for lucene,solr,elasticsearch,opensearch
java jcseg mmseg chinese-word-segmentation natural-language-processing pos-tagging nlp nlp-keywords-extraction lucene-analyzer lucene-tokenizer solr-plugin elasticsearch-analyzer chinese-text-segmentation chinese-nlp keywords-extraction jcseg-analyzer opensearch-analyzer opensearch-tokenizer elasticsearch-tokenizer
Language:Java 919
OYE93 / Chinese-NLP-Corpus
Collections of Chinese NLP corpus
chinese-nlp corpus datasets
Language:Python 911
Doragd / Chinese-Chatbot-PyTorch-Implementation
:four_leaf_clover: Another Chinese chatbot implemented in PyTorch, which is the sub-module of intelligent work order processing robot. 👩‍🔧
deep-learning chatbot pytorch pytorch-nlp chinese-nlp
Language:Python 908
ECNU-ICALK / EduChat
An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM
belle chinese-nlp data-cleaning education llama llm moss open-models
Language:Jupyter Notebook 878
thunlp / THULAC
An Efficient Lexical Analyzer for Chinese
chinese-nlp
Language:C++ 815
amutu / zhparser
zhparser is a PostgreSQL extension for full-text search of Chinese language
chinese chinese-nlp chinese-text-segmentation extension postgresql scws zhparser
Language:C 785
howl-anderson / Chinese_models_for_SpaCy
SpaCy 中文模型 | Models for SpaCy that support Chinese
chinese-nlp nlp nlp-dependency-parsing nlp-machine-learning spacy-models
Language:Jupyter Notebook 672
ydli-ai / CSL
[COLING 2022] CSL: A Large-scale Chinese Scientific Literature Dataset 中文科学文献数据集
chinese-nlp dataset machine-learning scientific-publications
Language:Python 649
rime / rime-cantonese
Rime Cantonese input schema | 粵語拼音輸入方案
rime rime-schema input-method cantonese cantonese-language cantonese-dictionary linguistics jyutping chinese chinese-nlp chinese-language
Language:Python 618
nonamestreet / weixin_public_corpus
微信公众号语料库
corpus nlp chinese-nlp natural-language-processing linguistics weixin weixin-data wei-xin corpora yu-liao yu-liao-ku
590
crownpku / Small-Chinese-Corpus
Some useful Chinese corpus datasets 中文语料小数据
chinese-nlp corpus
544
modelscope / AdaSeq
AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models
entity-typing named-entity-recognition natural-language-processing natural-language-understanding nlp pytorch sequence-labeling word-segmentation ner relation-extraction bert chinese-nlp crf information-extraction multi-modal-ner token-classification
Language:Python 450
guhhhhaa / 4675-scifi
chinese NLP corpus of chinese science fiction,chinese science fiction corpus : About 4675 Chinese science fiction novels 大约有4675本科幻小说，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
chinese-nlp corpus corpus-data datasets nlp nlp-datasets nlp-machine-learning nlp-resources science-fiction scifi
425
Walleclipse / ChineseAddress_OCR
Photographing Chinese-Address OCR implemented using CTPN+CTC+Address Correction. 拍照文档中文地址文字识别。
ocr text-detection text-recognition chinese-nlp keras-tensorflow
Language:Python 349
thunlp / THULAC-Java
An Efficient Lexical Analyzer for Chinese
chinese-nlp
Language:Java 336
jayeew / Chinese-ChatBot
中文聊天机器人，基于10万组对白训练而成，采用注意力机制，对一般问题都会生成一个有意义的答复。已上传模型，可直接运行。
seq2seq attention lstm rnn keras chinese-nlp chatbot seq2seq-chatbot jupyter
Language:Jupyter Notebook 325
linonetwo / segmentit
任何 JS 环境可用的中文分词包，fork from leizongmin/node-segment
chinese chinese-nlp nlp segmentation
Language:JavaScript 303
boat-group / fancy-nlp
NLP for human. A fast and easy-to-use natural language processing (NLP) toolkit, satisfying your imagination about NLP.
nlp chinese-nlp python-library keras tensorflow named-entity-recognition text-classification semantic-similarity tf2 bert-ner bert-chinese crf bimpm esim bert bilstm-crf bert-embeddings bert-classifier
Language:Python 286
cino
iflytek / cino
CINO: Pre-trained Language Models for Chinese Minority (少数民族语言预训练模型)
chinese-nlp cino nlp pytorch transformers xlm-roberta xlmr
Language:Python 253
zake7749 / Gossiping-Chinese-Corpus
PTT 八卦版問答中文語料
corpus chinese-corpus dataset dialog chatbot ptt chinese-chatbot chinese-dataset question-answering chinese-nlp chatbot-corpus
Language:Jupyter Notebook 246

chinese-nlp

pwxcoo / chinese-xinhua

brightmart / nlp_chinese_corpus

LianjiaTech / BELLE

crownpku / Awesome-Chinese-NLP

lyogavin / airllm

HIT-SCIR / ltp

IDEA-CCNL / Fengshenbang-LM

esbatmop / MNBVC

baidu / lac

fastnlp / fastNLP

CVI-SZU / Linly

crownpku / Information-Extraction-Chinese

thunlp / THULAC-Python

didi / ChineseNLP

HIT-SCIR / pyltp

baidu / DDParser

lionsoul2014 / jcseg

OYE93 / Chinese-NLP-Corpus

Doragd / Chinese-Chatbot-PyTorch-Implementation

ECNU-ICALK / EduChat

thunlp / THULAC

amutu / zhparser

howl-anderson / Chinese_models_for_SpaCy

ydli-ai / CSL

rime / rime-cantonese

nonamestreet / weixin_public_corpus

crownpku / Small-Chinese-Corpus

modelscope / AdaSeq

guhhhhaa / 4675-scifi

Walleclipse / ChineseAddress_OCR

thunlp / THULAC-Java

jayeew / Chinese-ChatBot

linonetwo / segmentit

boat-group / fancy-nlp

iflytek / cino

zake7749 / Gossiping-Chinese-Corpus