Natural language processing

Natural language processing (NLP) is the study of how computers and humans interact.

There are 25,818 repositories under nlp topic.

transformers
huggingface / transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
nlp natural-language-processing pytorch pytorch-transformers transformer model-hub pretrained-models speech-recognition hacktoberfest python machine-learning deep-learning audio deepseek gemma glm llm qwen vlm
Language:Python 149808
LLaMA-Factory
hiyouga / LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
fine-tuning llama llm peft transformers rlhf qlora quantization qwen instruction-tuning gpt lora large-language-models agent ai moe llama3 deepseek gemma nlp
Language:Python 58292
apachecn / ailearning
AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2
fp-growth apriori mahchine-leaning naivebayes svm adaboost kmeans svd pca logistic regression recommendedsystem sklearn scikit-learn nlp deeplearning python dnn lstm rnn
Language:Python 41437
AI-For-Beginners
microsoft / AI-For-Beginners
12 Weeks, 24 Lessons, AI for All!
deep-learning artificial-intelligence machine-learning ai computer-vision nlp cnn rnn gan microsoft-for-beginners
Language:Jupyter Notebook 40171
google-research / bert
TensorFlow code and pre-trained models for BERT
nlp google natural-language-processing natural-language-understanding tensorflow
Language:Python 39510
HanLP
hankcs / HanLP
中文分词词性标注命名实体识别依存句法分析成分句法分析语义依存分析语义角色标注指代消解风格转换语义相似度新词发现关键词短语提取自动摘要文本分类聚类拼音简繁转换自然语言处理
dependency-parser hanlp named-entity-recognition natural-language-processing nlp pos-tagging semantic-parsing text-classification
Language:Python 35627
explosion / spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
natural-language-processing data-science machine-learning python cython nlp artificial-intelligence ai spacy nlp-library neural-network neural-networks deep-learning named-entity-recognition entity-linking text-classification tokenization
Language:Python 32479
storm
stanford-oval / storm
An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.
large-language-models nlp knowledge-curation naacl report-generation retrieval-augmented-generation emnlp2024 agentic-rag deep-research
Language:Python 27401
ashishpatel26 / 500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code
500 AI Machine learning Deep learning Computer vision NLP Projects with code
awesome machine-learning deep-learning machine-learning-projects deep-learning-project computer-vision-project nlp-projects artificial-intelligence-projects python artificial-intelligence data-science computer-vision nlp
27280
haystack
deepset-ai / haystack
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
nlp question-answering pytorch semantic-search information-retrieval summarization transformers machine-learning ai python large-language-models generative-ai llm rag retrieval-augmented-generation agents agent gemini gpt-4 orchestration
Language:Python 22502
lukasmasuch / best-of-ml-python
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
python machine-learning data-science nlp data-visualization tensorflow pytorch scikit-learn keras data-visualizations deep-learning automl ml jax transformer data-analysis chatgpt gpt gpt-3
21916
microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
nlp pre-trained-model unilm minilm layoutlm layoutxlm beit document-ai trocr beit-3 foundation-models xlm-e deepnet llm multimodal mllm kosmos kosmos-1 textdiffuser bitnet
Language:Python 21721
HqWu-HITCS / Awesome-Chinese-LLM
整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。
llm nlp chatglm chinese llama awesome-lists
21196
rasa
RasaHQ / rasa
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
nlp machine-learning machine-learning-library bot bots botkit rasa wit nlu conversational-bots conversational-agents conversational-ai spacy mitie chatbot chatbots chatbots-framework bot-framework natural-language-processing conversation-driven-development
Language:Python 20671
datasets
huggingface / datasets
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
nlp datasets pytorch tensorflow pandas numpy natural-language-processing computer-vision machine-learning deep-learning speech ai artificial-intelligence llm dataset-hub
Language:Python 20647
Chinese-LLaMA-Alpaca
ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llm plm pre-trained-language-models alpaca llama nlp quantization large-language-models lora alpaca-2 llama-2
Language:Python 18920
keon / awesome-nlp
:book: A curated list of resources dedicated to Natural Language Processing (NLP)
natural-language-processing deep-learning machine-learning language awesome awesome-list nlp text-mining
17543
AI4Finance-Foundation / FinGPT
FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
chatgpt finance fintech large-language-models machine-learning nlp prompt-engineering pytorch reinforcement-learning robo-advisor sentiment-analysis technical-analysis fingpt
Language:Jupyter Notebook 17536
NLP-LOVE / ML-NLP
此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现，也是作为一个算法工程师必会的理论基础知识。
nlp machine-learning deep-learning
Language:Jupyter Notebook 17115
dair-ai / ML-YouTube-Courses
📺 Discover the latest machine learning / AI courses on YouTube.
ai data-science deep-learning machine-learning natural-language-processing nlp
16926
gensim
piskvorky / gensim
Topic Modelling for Humans
gensim topic-modeling information-retrieval machine-learning natural-language-processing nlp data-science python data-mining word2vec word-embeddings neural-network document-similarity word-similarity fasttext
Language:Python 16186
bharathgs / Awesome-pytorch-list
A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.
pytorch python machine-learning deep-learning tutorials papers awesome awesome-list pytorch-tutorials data-science nlp nlp-library cv computer-vision natural-language-processing facebook probabilistic-programming utility-library neural-network pytorch-model
16144
oxford-cs-deepnlp-2017 / lectures
Oxford Deep NLP 2017 course
deep-learning machine-learning natural-language-processing nlp oxford
15862
google / langextract
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
llm nlp python gemini-ai information-extration large-language-models structured-data gemini gemini-api gemini-flash gemini-pro
Language:Python 15047
graykode / nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
nlp natural-language-processing tutorial pytorch tensorflow transformer attention paper bert
Language:Jupyter Notebook 14729
NVIDIA / DeepLearningExamples
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
computer-vision deep-learning drug-discovery forecasting large-language-models mxnet paddlepaddle pytorch recommender-systems speech-recognition speech-synthesis tensorflow tensorflow2 translation nlp
Language:Jupyter Notebook 14484
flairNLP / flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
pytorch nlp named-entity-recognition sequence-labeling semantic-role-labeling word-embeddings natural-language-processing machine-learning
Language:Python 14288
nltk / nltk
NLTK Source
nltk python nlp natural-language-processing machine-learning
Language:Python 14281
virgili0 / Virgilio
Your new Mentor for Data Science E-Learning.
tensorflow machine-learning machine-vision datascience scikit-learn python guide guidelines path study studypath learning learning-python computer-vision nlp statistics business-intelligence data-science virgilio hacktoberfest
Language:Jupyter Notebook 14199
botpress / botpress
The open-source hub to build & deploy GPT/LLM Agents ⚡️
agent ai botpress chatbot chatgpt gpt gpt-4 llm openai langchain nlp prompt
Language:TypeScript 14194
PaddleNLP
PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine semantic-analysis sentiment-analysis neural-search uie document-intelligence compression llm distributed-training llama
Language:Python 12762
Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
deep-learning document-parsing machine-learning nlp ocr information-retrieval data-pipelines ml preprocessing pdf-to-text natural-language-processing pdf pdf-to-json document-image-analysis donut document-image-processing document-parser docx langchain llm
Language:HTML 12660
dair-ai / ML-Papers-of-the-Week
🔥Highlighting the top ML papers every week.
ai data-science deeplearning machine-learning nlp
11903
allenai / allennlp
An open-source NLP research library, built on PyTorch.
data-science deep-learning natural-language-processing nlp python pytorch
Language:Python 11877
spencermountain / compromise
modest natural-language processing
nlp part-of-speech named-entity-recognition
Language:JavaScript 11863
tangyudi / Ai-Learn
人工智能学习路线图，整理近200个实战案例与项目，免费提供配套教材，零基础入门，就业实战！包括：Python，数学，机器学习，数据分析，深度学习，计算机视觉，自然语言处理，PyTorch tensorflow machine-learning,deep-learning data-analysis data-mining mathematics data-science artificial-intelligence python tensorflow tensorflow2 caffe keras pytorch algorithm numpy pandas matplotlib seaborn nlp cv等热门领域
machine-learning deep-learning data-analysis data-mining mathematics data-science artificial-intelligence python tensorflow tensorflow2 caffe keras pytorch algorithm numpy pandas matplotlib seaborn nlp cv
11790