nlp-library

There are 36 repositories under nlp-library topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
nlp natural-language-processing pytorch language-model tensorflow bert language-models pytorch-transformers nlp-library transformer model-hub pretrained-models jax flax seq2seq speech-recognition hacktoberfest python machine-learning deep-learning
Language:Python 88213
explosion / spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
natural-language-processing data-science machine-learning python cython nlp artificial-intelligence ai spacy nlp-library neural-network neural-networks deep-learning named-entity-recognition entity-linking text-classification tokenization
Language:Python 25624
bharathgs / Awesome-pytorch-list
A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.
pytorch python machine-learning deep-learning tutorials papers awesome awesome-list pytorch-tutorials data-science nlp nlp-library cv computer-vision natural-language-processing facebook probabilistic-programming utility-library neural-network pytorch-model
13870
fastnlp / fastNLP
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
natural-language-processing deep-learning nlp-library nlp-parsing chinese-nlp text-classification text-processing
Language:Python 2874
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
nlp pre-trained-language-models ai nlp-machine-learning natural-language-processing natural-language-understanding deep-learning pre-trained-model nlp-library pytorch transformer prompt prompt-toolkit prompts prompt-based-tuning prompt-learning
Language:Python 2766
FudanNLP / fnlp
中文自然语言处理工具包 Toolkit for Chinese natural language processing
fudannlp fnlp java nlp-library
Language:Java 2587
FARM
deepset-ai / FARM
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
language-models bert nlp deep-learning transfer-learning pytorch nlp-library nlp-framework xlnet-pytorch ner question-answering pretrained-models roberta germanbert
Language:Python 1648
xavier-zy / Awesome-pytorch-list-CNVersion
Awesome-pytorch-list 翻译工作进行中......
pytorch python machine-learning deep-learning tutorials papers pytorch-tutorials data-sicence nlp nlp-library cv computer-vision facebook probabilistic-programming utility-library neural-network pytorch-models awsome-pytorch-list cnversion
Language:Jupyter Notebook 1623
chrismattmann / tika-python
Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
tika-server python tika-python tika-server-jar parser-interface parse translation-interface usc text-extraction mime buffer memex text-recognition detection recognition nlp nlp-machine-learning nlp-library covid-19 extraction
Language:Python 1254
underthesea
undertheseanlp / underthesea
Underthesea - Vietnamese NLP Toolkit
nlp nlp-library vietnamese-nlp vietnamese natural-language-processing vietnamese-tokenizer word-segmenter sentence-segmentation named-entity-recognition ner dependency-parsing pos-tagging dependency-parser
Language:Python 1112
MilaNLProc / contextualized-topic-models
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021.
topic-modeling bert transformer embeddings text-as-data topic-coherence multilingual-topic-models multilingual-models neural-topic-models nlp nlp-library nlp-machine-learning
Language:Python 1036
NorskRegnesentral / skweak
skweak: A software toolkit for weak supervision applied to NLP tasks
weak-supervision nlp-machine-learning distant-supervision nlp-library spacy python data-science training-data natural-language-processing
Language:Python 870
atilika / kuromoji
Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search
japanese morphological-analyser nlp-library part-of-speech-tagger
Language:Java 862
PyThaiNLP / pythainlp
Thai Natural Language Processing in Python.
python thai-nlp nlp-library thai-language natural-language-processing thai-nlp-library thai-soundex soundex word-segmentation thai hacktoberfest hacktoberfest-accepted hacktoberfest2023
Language:Python 791
mocobeta / janome
Japanese morphological analysis engine written in pure Python
python nlp-library japanese-language
Language:Python 758
ikawaha / kagome
Self-contained Japanese Morphological Analyzer written in pure Go
japanese tokenizer nlp-library japanese-language pos-tagging segmentation morphological-analysis korean hacktoberfest
Language:Go 712
ashishpatel26 / Treasure-of-Transformers
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
transformer python nlp natural-language-processing tensorflow pytorch speech-recognition seq2seq pretrained-models language-models natural-language-generation nlp-library bert natural-language-understanding language-model pytorch-transformers model-hub jax awesome
Language:Jupyter Notebook 678
WorksApplications / Sudachi
A Japanese Tokenizer for Business
morphological-analysis segmentation nlp-library pos-tagging
Language:Java 646
wyounas / homer
Homer, a text analyser in Python, can help make your text more clear, simple and useful for your readers.
python python3 python-library text-analysis python-script nlp nlp-library
Language:Python 631
cbaziotis / ekphrasis
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
nlp text-processing nlp-library spelling-correction tokenizer tokenization word-segmentation word-normalization spell-corrector text-segmentation semeval
Language:Python 615
pemistahl / lingua
The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike
language-detection language-processing kotlin-library java-library nlp-library nlp nlp-machine-learning natural-language natural-language-processing android-library language-identification language-classification language-recognition
Language:Kotlin 563
OCTIS
MIND-Lab / OCTIS
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
topic-modeling latent-dirichlet-allocation latent-semantic-analysis evaluation-metrics natural-language-processing non-negative-matrix-factorization neural-topic-models bayesian-optimization hyperparameter-optimization hyperparameter-tuning hyperparameter-search topic-models nlp nlproc nlp-library
Language:Python 535
thunlp / OpenDelta
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
nlp nlp-library pretrained-language-model parameter-efficient-learning deep-learning
Language:Python 525
Ailln / cn2an
📦 快速转化「中文数字」和「阿拉伯数字」～ (最新特性：分数，日期、温度等转化）
arabic-numerals chinese-numerals python arabic-numbers nlp-tool nlp-library speech-recognition asr pypi cn2an
Language:Python 469
proycon / pynlpl
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).
nlp python computational-linguistics linguistics library folia machine-learning language-modelling search-algorithms evaluation-metrics text-processing nlp-library natural-language-processing
Language:Python 460
fhamborg / Giveme5W1H
Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?
question answering news event-detection event-extraction fivewoneh fivew 5w1h 5w question-answering news-articles text-analysis nlp nlp-library
Language:HTML 448
pyarabic
linuxscout / pyarabic
pyarabic
nlp-library arabic-language text-processing
Language:Python 364
medspacy / medspacy
Library for clinical NLP with spaCy.
nlp nlp-library spacy clinical-nlp pipeline medspacy
Language:Jupyter Notebook 352
WorksApplications / SudachiPy
Python version of Sudachi, a Japanese tokenizer.
nlp-library morphological-analysis segmentation pos-tagging
Language:Python 349
hellohaptik / multi-task-NLP
multi_task_NLP is a utility toolkit enabling NLP developers to easily train and infer a single model for multiple tasks.
pytorch multitask-learning sentence-classification sequence-labeling entailment ranking intent-classification named-entity-recognition machine-comprehension context-awareness transformers nlp nlp-library nli-tasks nlp-datasets nlp-apis
Language:Python 334
nagisa
taishi-i / nagisa
A Japanese tokenizer based on recurrent neural networks
dynet word-segmentation pos-tagging japanese nlp-library sequence-labeling natural-language-processing nlp tokenizer
Language:Python 331
hellohaptik / chatbot_ner
chatbot_ner: Named Entity Recognition for chatbots.
named-entity-recognition chatbots natural-language-processing nlp-library ner nlp chatbot-ner entity chatbot elasticsearch gazetteer
Language:Python 317
CAMeL-Lab / camel_tools
A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.
morphological-analysis nlp nlp-library nlp-apis arabic dialect-identification sentiment-analysis named-entity-recognition stemming pos-tagging arabic-dialects morphological-generation morphological-disambiguation morphological-reinflection
Language:Python 298
taishi-i / awesome-japanese-nlp-resources
A curated list of resources dedicated to Python libraries, pre-trained models, dictionaries, and corpora of NLP for Japanese
awesome japanese natural-language-processing nlp nlp-library japanese-language awesome-list rust-crate cc0
296
outcastofmusic / quick-nlp
Pytorch NLP library based on FastAI
pytorch fastai nlp-library seq2seq
Language:Python 283
urduhack / urduhack
An NLP library for the Urdu language. It comes with a lot of battery included features to help you process Urdu data in the easiest way possible.
urdu urdu-language urdu-nlp machine-learning deep-learning urdu-text-processsing deeplearning python tensorflow urdu-hack urduhack nlp-library sponsors backer
Language:Python 252