Natural language processing

Natural language processing (NLP) is the study of how computers and humans interact.

There are 24,184 repositories under nlp topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
bert deep-learning flax hacktoberfest jax language-model language-models machine-learning model-hub natural-language-processing nlp nlp-library pretrained-models python pytorch pytorch-transformers seq2seq speech-recognition tensorflow transformer
Language:Python 129796
apachecn / ailearning
AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2
adaboost apriori deeplearning dnn fp-growth kmeans logistic lstm mahchine-leaning naivebayes nlp pca python recommendedsystem regression rnn scikit-learn sklearn svd svm
Language:Python 38778
google-research / bert
TensorFlow code and pre-trained models for BERT
google natural-language-processing natural-language-understanding nlp tensorflow
Language:Python 37550
AI-For-Beginners
microsoft / AI-For-Beginners
12 Weeks, 24 Lessons, AI for All!
ai artificial-intelligence cnn computer-vision deep-learning gan machine-learning nlp rnn
Language:Jupyter Notebook 33437
HanLP
hankcs / HanLP
中文分词词性标注命名实体识别依存句法分析成分句法分析语义依存分析语义角色标注指代消解风格转换语义相似度新词发现关键词短语提取自动摘要文本分类聚类拼音简繁转换自然语言处理
nlp natural-language-processing hanlp pos-tagging dependency-parser text-classification named-entity-recognition semantic-parsing
Language:Python 33165
explosion / spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
natural-language-processing data-science machine-learning python cython nlp artificial-intelligence ai spacy nlp-library neural-network neural-networks deep-learning named-entity-recognition entity-linking text-classification tokenization
Language:Python 29361
microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
nlp pre-trained-model unilm minilm layoutlm layoutxlm beit document-ai trocr beit-3 foundation-models xlm-e deepnet llm multimodal mllm kosmos kosmos-1 textdiffuser bitnet
Language:Python 19249
ashishpatel26 / 500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code
500 AI Machine learning Deep learning Computer vision NLP Projects with code
awesome machine-learning deep-learning machine-learning-projects deep-learning-project computer-vision-project nlp-projects artificial-intelligence-projects python artificial-intelligence data-science computer-vision nlp
19009
datasets
huggingface / datasets
🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
nlp datasets pytorch tensorflow pandas numpy natural-language-processing computer-vision machine-learning deep-learning speech hacktoberfest
Language:Python 18801
rasa
RasaHQ / rasa
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
nlp machine-learning machine-learning-library bot bots botkit rasa wit nlu conversational-bots conversational-agents conversational-ai spacy mitie chatbot chatbots chatbots-framework bot-framework natural-language-processing conversation-driven-development
Language:Python 18372
Chinese-LLaMA-Alpaca
ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llm plm pre-trained-language-models alpaca llama nlp quantization large-language-models lora alpaca-2 llama-2
Language:Python 17982
keon / awesome-nlp
:book: A curated list of resources dedicated to Natural Language Processing (NLP)
awesome awesome-list deep-learning language machine-learning natural-language-processing nlp text-mining
16326
ml-tooling / best-of-ml-python
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
python machine-learning data-science nlp data-visualization tensorflow pytorch scikit-learn keras data-visualizations deep-learning automl ml jax transformer data-analysis chatgpt gpt gpt-3
16103
oxford-cs-deepnlp-2017 / lectures
Oxford Deep NLP 2017 course
deep-learning machine-learning natural-language-processing nlp oxford
15620
NLP-LOVE / ML-NLP
此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现，也是作为一个算法工程师必会的理论基础知识。
nlp machine-learning deep-learning
Language:Jupyter Notebook 15531
gensim
piskvorky / gensim
Topic Modelling for Humans
data-mining data-science document-similarity fasttext gensim information-retrieval machine-learning natural-language-processing neural-network nlp python topic-modeling word-embeddings word-similarity word2vec
Language:Python 15466
bharathgs / Awesome-pytorch-list
A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.
pytorch python machine-learning deep-learning tutorials papers awesome awesome-list pytorch-tutorials data-science nlp nlp-library cv computer-vision natural-language-processing facebook probabilistic-programming utility-library neural-network pytorch-model
15198
haystack
deepset-ai / haystack
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
ai bert chatgpt generative-ai gpt-3 information-retrieval language-model large-language-models llm machine-learning nlp python pytorch question-answering rag retrieval-augmented-generation semantic-search squad summarization transformers
Language:Python 14825
dair-ai / ML-YouTube-Courses
📺 Discover the latest machine learning / AI courses on YouTube.
ai data-science deep-learning machine-learning natural-language-processing nlp
14590
graykode / nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
nlp natural-language-processing tutorial pytorch tensorflow transformer attention paper bert
Language:Jupyter Notebook 13944
virgili0 / Virgilio
Your new Mentor for Data Science E-Learning.
business-intelligence computer-vision data-science datascience guide guidelines hacktoberfest learning learning-python machine-learning machine-vision nlp path python scikit-learn statistics study studypath tensorflow virgilio
Language:Jupyter Notebook 13822
flairNLP / flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
machine-learning named-entity-recognition natural-language-processing nlp pytorch semantic-role-labeling sequence-labeling word-embeddings
Language:Python 13749
HqWu-HITCS / Awesome-Chinese-LLM
整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。
llm nlp chatglm chinese llama awesome-lists
13709
nltk / nltk
NLTK Source
nltk python nlp natural-language-processing machine-learning
Language:Python 13285
NVIDIA / DeepLearningExamples
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
computer-vision deep-learning drug-discovery forecasting large-language-models mxnet paddlepaddle pytorch recommender-systems speech-recognition speech-synthesis tensorflow tensorflow2 translation nlp
Language:Jupyter Notebook 13046
AI4Finance-Foundation / FinGPT
FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
chatgpt finance fintech large-language-models machine-learning nlp prompt-engineering pytorch reinforcement-learning robo-advisor sentiment-analysis technical-analysis fingpt
Language:Jupyter Notebook 12735
infiniflow / ragflow
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
agent agents chatbot data-pipelines deep-learning document-parser document-understanding information-retrieval llm machine-learning nlp ocr orchestration pdf-to-text preprocessing rag retrieval-augmented-generation table-structure-recognition
Language:Python 12652
PaddleHub
PaddlePaddle / PaddleHub
Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)
awesome deep-learning model nlp text2image vision
Language:Python 12631
botpress / botpress
The open-source hub to build & deploy GPT/LLM Agents ⚡️
agent ai botpress chatbot chatgpt gpt gpt-4 langchain llm nlp openai prompt
Language:TypeScript 12310
PaddleNLP
PaddlePaddle / PaddleNLP
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine semantic-analysis sentiment-analysis neural-search uie document-intelligence compression llm distributed-training llama
Language:Python 11793
allenai / allennlp
An open-source NLP research library, built on PyTorch.
data-science deep-learning natural-language-processing nlp python pytorch
Language:Python 11718
spencermountain / compromise
modest natural-language processing
named-entity-recognition nlp part-of-speech
Language:JavaScript 11340
chiphuyen / stanford-tensorflow-tutorials
This repository contains code examples for the Stanford's course: TensorFlow for Deep Learning Research.
chatbot course-materials deep-learning machine-learning natural-language-processing nlp python stanford tensorflow tutorial
Language:Python 10313
stanfordnlp / CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
named-entity-recognition natural-language-processing nlp nlp-parsing stanford-nlp
Language:Java 9584
dair-ai / ML-Papers-of-the-Week
🔥Highlighting the top ML papers every week.
ai data-science deeplearning machine-learning nlp
9488
ymcui / Chinese-BERT-wwm
Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
chinese-bert tensorflow pytorch bert nlp roberta bert-wwm bert-wwm-ext roberta-wwm rbt
Language:Python 9476