chinese-nlp

There are 97 repositories under chinese-nlp topic.

pwxcoo / chinese-xinhua
:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。
data scraper chinese-traditional python3 chinese chinese-characters chinese-nlp chinese-language chinese-simplified json-dataset json json-data
Language:Python 10672
brightmart / nlp_chinese_corpus
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
chinese-dataset chinese-corpus pretrain word2vec nlp bert language-model wiki news question-answering chinese corpus chinese-nlp dataset text-classification
9209
crownpku / Awesome-Chinese-NLP
A curated list of resources for Chinese NLP 中文自然语言处理相关资料
nlp chinese-nlp
7687
LianjiaTech / BELLE
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
bloom instruction-set llama open-models gpt-q instruct-gpt gpt-evaluation chinese-nlp lora instruct-finetune
Language:HTML 7584
HIT-SCIR / ltp
Language Technology Platform
nlp natural-language-processing chinese-nlp machine-learning
Language:Python 4820
Fengshenbang-LM
IDEA-CCNL / Fengshenbang-LM
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。
chinese-nlp pretrained-models pytorch distributed-training transformers aigc multimodal
Language:Python 3913
baidu / lac
百度NLP：分词，词性标注，命名实体识别，词重要性
word-segmentation part-of-speech-tagger named-entity-recognition chinese-word-segmentation chinese-nlp lexical-analysis python java
Language:C++ 3768
lyogavin / Anima
33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
chinese-nlp finetune generative-ai instruct-gpt instruction-set llama llm lora open-models open-source open-source-models qlora chinese-llm
Language:Jupyter Notebook 3293
esbatmop / MNBVC
MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
chinese chinese-language chinese-nlp chinese-simplified corpus-data nlp nlp-machine-learning
3048
fastnlp / fastNLP
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
natural-language-processing deep-learning nlp-library nlp-parsing chinese-nlp text-classification text-processing
Language:Python 3035
CVI-SZU / Linly
Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
bert gpt-3 language-model llama nlp zero-shot-learning chatbot chatgpt chinese chinese-nlp
Language:Python 2994
crownpku / Information-Extraction-Chinese
Chinese Named Entity Recognition with IDCNN/biLSTM+CRF, and Relation Extraction with biGRU+2ATT 中文实体识别与关系提取
nlp chinese-nlp information-extraction relation-extraction named-entity-recognition
Language:Python 2200
thunlp / THULAC-Python
An Efficient Lexical Analyzer for Chinese
chinese-nlp
Language:Python 1970
didi / ChineseNLP
Datasets, SOTA results of every fields of Chinese NLP
nlp chinese-nlp machine-translation chinese-word-segmentation entity-linking question-answering nlp-tasks
Language:HTML 1774
HIT-SCIR / pyltp
pyltp: the python extension for LTP
python chinese-nlp
Language:C++ 1524
baidu / DDParser
百度开源的依存句法分析系统
dependency-parser chinese-nlp python chinese-dependency-parser dependency-parsing syntax-parser
Language:Python 954
lionsoul2014 / jcseg
Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction implemented based on TEXTRANK algorithm. Jcseg had a build-in http server and search modules for lucene,solr,elasticsearch,opensearch
java jcseg mmseg chinese-word-segmentation natural-language-processing pos-tagging nlp nlp-keywords-extraction lucene-analyzer lucene-tokenizer solr-plugin elasticsearch-analyzer chinese-text-segmentation chinese-nlp keywords-extraction jcseg-analyzer opensearch-analyzer opensearch-tokenizer elasticsearch-tokenizer
Language:Java 905
Doragd / Chinese-Chatbot-PyTorch-Implementation
:four_leaf_clover: Another Chinese chatbot implemented in PyTorch, which is the sub-module of intelligent work order processing robot. 👩‍🔧
deep-learning chatbot pytorch pytorch-nlp chinese-nlp
Language:Python 856
OYE93 / Chinese-NLP-Corpus
Collections of Chinese NLP corpus
chinese-nlp datasets corpus
Language:Python 851
thunlp / THULAC
An Efficient Lexical Analyzer for Chinese
chinese-nlp
Language:C++ 771
amutu / zhparser
zhparser is a PostgreSQL extension for full-text search of Chinese language
zhparser scws postgresql extension chinese chinese-text-segmentation chinese-nlp
Language:C 664
howl-anderson / Chinese_models_for_SpaCy
SpaCy 中文模型 | Models for SpaCy that support Chinese
spacy-models nlp-machine-learning nlp nlp-dependency-parsing chinese-nlp
Language:Jupyter Notebook 633
ECNU-ICALK / EduChat
An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM
belle chinese-nlp data-cleaning education llama llm moss open-models
Language:Python 611
nonamestreet / weixin_public_corpus
微信公众号语料库
corpus nlp chinese-nlp natural-language-processing linguistics weixin weixin-data wei-xin corpora yu-liao yu-liao-ku
563
crownpku / Small-Chinese-Corpus
Some useful Chinese corpus datasets 中文语料小数据
corpus chinese-nlp
526
ydli-ai / CSL
[COLING 2022] CSL: A Large-scale Chinese Scientific Literature Dataset 中文科学文献数据集
chinese-nlp dataset machine-learning scientific-publications
Language:Python 525
rime / rime-cantonese
Rime Cantonese input schema | 粵語拼音輸入方案
rime rime-schema input-method cantonese cantonese-language cantonese-dictionary linguistics jyutping chinese chinese-nlp chinese-language
Language:Python 500
modelscope / AdaSeq
AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models
entity-typing named-entity-recognition natural-language-processing natural-language-understanding nlp pytorch sequence-labeling word-segmentation ner relation-extraction bert chinese-nlp crf information-extraction multi-modal-ner token-classification
Language:Python 367
Walleclipse / ChineseAddress_OCR
Photographing Chinese-Address OCR implemented using CTPN+CTC+Address Correction. 拍照文档中文地址文字识别。
ocr text-detection text-recognition chinese-nlp keras-tensorflow
Language:Python 348
guhhhhaa / 4675-scifi
chinese NLP corpus of chinese science fiction,chinese science fiction corpus : About 4675 Chinese science fiction novels 大约有4675本科幻小说，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
scifi corpus corpus-data nlp nlp-datasets nlp-machine-learning nlp-resources science-fiction chinese-nlp datasets
326
thunlp / THULAC-Java
An Efficient Lexical Analyzer for Chinese
chinese-nlp
Language:Java 325
jayeew / Chinese-ChatBot
中文聊天机器人，基于10万组对白训练而成，采用注意力机制，对一般问题都会生成一个有意义的答复。已上传模型，可直接运行。
seq2seq attention lstm rnn keras chinese-nlp chatbot seq2seq-chatbot jupyter
Language:Jupyter Notebook 321
boat-group / fancy-nlp
NLP for human. A fast and easy-to-use natural language processing (NLP) toolkit, satisfying your imagination about NLP.
nlp chinese-nlp python-library keras tensorflow named-entity-recognition text-classification semantic-similarity tf2 bert-ner bert-chinese crf bimpm esim bert bilstm-crf bert-embeddings bert-classifier
Language:Python 282
linonetwo / segmentit
任何 JS 环境可用的中文分词包，fork from leizongmin/node-segment
nlp segmentation chinese-nlp chinese
Language:JavaScript 248
howl-anderson / WeatherBot
一个基于 Rasa 的中文天气情况问询机器人(chatbot), 带 Web UI 界面
chinese-chatbot weather-bot chinese-nlp task-oriented-dialogue chatbot chatbot-application
235
g2pC
Kyubyong / g2pC
g2pC: A Context-aware Grapheme-to-Phoneme Conversion module for Chinese
g2p pinyin crf crfsuite chinese-nlp chinese-word-segmentation
Language:Python 231

chinese-nlp

pwxcoo / chinese-xinhua

brightmart / nlp_chinese_corpus

crownpku / Awesome-Chinese-NLP

LianjiaTech / BELLE

HIT-SCIR / ltp

IDEA-CCNL / Fengshenbang-LM

baidu / lac

lyogavin / Anima

esbatmop / MNBVC

fastnlp / fastNLP

CVI-SZU / Linly

crownpku / Information-Extraction-Chinese

thunlp / THULAC-Python

didi / ChineseNLP

HIT-SCIR / pyltp

baidu / DDParser

lionsoul2014 / jcseg

Doragd / Chinese-Chatbot-PyTorch-Implementation

OYE93 / Chinese-NLP-Corpus

thunlp / THULAC

amutu / zhparser

howl-anderson / Chinese_models_for_SpaCy

ECNU-ICALK / EduChat

nonamestreet / weixin_public_corpus

crownpku / Small-Chinese-Corpus

ydli-ai / CSL

rime / rime-cantonese

modelscope / AdaSeq

Walleclipse / ChineseAddress_OCR

guhhhhaa / 4675-scifi

thunlp / THULAC-Java

jayeew / Chinese-ChatBot

boat-group / fancy-nlp

linonetwo / segmentit

howl-anderson / WeatherBot

Kyubyong / g2pC