nlp-library

There are 42 repositories under nlp-library topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
bert deep-learning flax hacktoberfest jax language-model language-models machine-learning model-hub natural-language-processing nlp nlp-library pretrained-models python pytorch pytorch-transformers seq2seq speech-recognition tensorflow transformer
Language:Python 128459
explosion / spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
ai artificial-intelligence cython data-science deep-learning entity-linking machine-learning named-entity-recognition natural-language-processing neural-network neural-networks nlp nlp-library python spacy text-classification tokenization
Language:Python 29192
bharathgs / Awesome-pytorch-list
A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.
awesome awesome-list computer-vision cv data-science deep-learning facebook machine-learning natural-language-processing neural-network nlp nlp-library papers probabilistic-programming python pytorch pytorch-model pytorch-tutorials tutorials utility-library
15126
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
nlp pre-trained-language-models ai nlp-machine-learning natural-language-processing natural-language-understanding deep-learning pre-trained-model nlp-library pytorch transformer prompt prompt-toolkit prompts prompt-based-tuning prompt-learning
Language:Python 4230
fastnlp / fastNLP
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
chinese-nlp deep-learning natural-language-processing nlp-library nlp-parsing text-classification text-processing
Language:Python 3046
FudanNLP / fnlp
中文自然语言处理工具包 Toolkit for Chinese natural language processing
fnlp fudannlp java nlp-library
Language:Java 2639
FARM
deepset-ai / FARM
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
language-models bert nlp deep-learning transfer-learning pytorch nlp-library nlp-framework xlnet-pytorch ner question-answering pretrained-models roberta germanbert
Language:Python 1732
xavier-zy / Awesome-pytorch-list-CNVersion
Awesome-pytorch-list 翻译工作进行中......
pytorch python machine-learning deep-learning tutorials papers pytorch-tutorials data-sicence nlp nlp-library cv computer-vision facebook probabilistic-programming utility-library neural-network pytorch-models awsome-pytorch-list cnversion
Language:Jupyter Notebook 1712
chrismattmann / tika-python
Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
buffer covid-19 detection extraction memex mime nlp nlp-library nlp-machine-learning parse parser-interface python recognition text-extraction text-recognition tika-python tika-server tika-server-jar translation-interface usc
Language:Python 1448
underthesea
undertheseanlp / underthesea
Underthesea - Vietnamese NLP Toolkit
nlp nlp-library vietnamese-nlp vietnamese natural-language-processing vietnamese-tokenizer word-segmenter sentence-segmentation named-entity-recognition ner dependency-parsing pos-tagging dependency-parser
Language:Python 1341
MilaNLProc / contextualized-topic-models
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).
bert embeddings multilingual-models multilingual-topic-models neural-topic-models nlp nlp-library nlp-machine-learning text-as-data topic-coherence topic-modeling transformer
Language:Python 1183
thunlp / OpenDelta
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
deep-learning nlp nlp-library parameter-efficient-learning pretrained-language-model
Language:Python 955
atilika / kuromoji
Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search
japanese morphological-analyser nlp-library part-of-speech-tagger
Language:Java 936
PyThaiNLP / pythainlp
Thai Natural Language Processing in Python.
hacktoberfest hacktoberfest-accepted natural-language-processing nlp-library python soundex thai thai-language thai-nlp thai-nlp-library thai-soundex word-segmentation
Language:Python 936
NorskRegnesentral / skweak
skweak: A software toolkit for weak supervision applied to NLP tasks
weak-supervision nlp-machine-learning distant-supervision nlp-library spacy python data-science training-data natural-language-processing
Language:Python 914
ashishpatel26 / Treasure-of-Transformers
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
transformer python nlp natural-language-processing tensorflow pytorch speech-recognition seq2seq pretrained-models language-models natural-language-generation nlp-library bert natural-language-understanding language-model pytorch-transformers model-hub jax awesome
Language:Jupyter Notebook 865
mocobeta / janome
Japanese morphological analysis engine written in pure Python
japanese-language nlp-library python
Language:Python 840
ikawaha / kagome
Self-contained Japanese Morphological Analyzer written in pure Go
japanese tokenizer nlp-library japanese-language pos-tagging segmentation morphological-analysis korean hacktoberfest
Language:Go 799
WorksApplications / Sudachi
A Japanese Tokenizer for Business
morphological-analysis nlp-library pos-tagging segmentation
Language:Java 759
DataDreamer
datadreamer-dev / DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
deep-learning machine-learning natural-language-processing nlp nlp-library python pytorch transformers alignment fine-tuning gpt instruction-tuning llm llmops llms openai synthetic-data synthetic-dataset-generation
Language:Python 726
OCTIS
MIND-Lab / OCTIS
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
bayesian-optimization evaluation-metrics hyperparameter-optimization hyperparameter-search hyperparameter-tuning latent-dirichlet-allocation latent-semantic-analysis natural-language-processing neural-topic-models nlp nlp-library nlproc non-negative-matrix-factorization topic-modeling topic-models
Language:Python 703
lingua
pemistahl / lingua
The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike
language-detection language-processing kotlin-library java-library nlp-library nlp nlp-machine-learning natural-language natural-language-processing android-library language-identification language-classification language-recognition
Language:Kotlin 665
cbaziotis / ekphrasis
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
nlp nlp-library semeval spell-corrector spelling-correction text-processing text-segmentation tokenization tokenizer word-normalization word-segmentation
Language:Python 660
wyounas / homer
Homer, a text analyser in Python, can help make your text more clear, simple and useful for your readers.
nlp nlp-library python python-library python-script python3 text-analysis
Language:Python 633
Ailln / cn2an
📦 快速转化「中文数字」和「阿拉伯数字」～ (最新特性：分数，日期、温度等转化）
arabic-numbers arabic-numerals asr chinese-numerals cn2an nlp-library nlp-tool pypi python speech-recognition
Language:Python 627
taishi-i / awesome-japanese-nlp-resources
A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese
awesome japanese natural-language-processing nlp nlp-library japanese-language awesome-list cc0 llm
618
mindspore-lab / mindnlp
Easy-to-use and high-performance NLP and LLM framework based on MindSpore, compatible with models and datasets of 🤗Huggingface.
mindspore natural-language-processing nlp nlp-library deep-learning python large-language-models llm
Language:Python 568
fhamborg / Giveme5W1H
Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?
5w 5w1h answering event-detection event-extraction fivew fivewoneh news news-articles nlp nlp-library question question-answering text-analysis
Language:HTML 502
medspacy / medspacy
Library for clinical NLP with spaCy.
nlp nlp-library spacy clinical-nlp pipeline medspacy
Language:Jupyter Notebook 492
proycon / pynlpl
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).
nlp python computational-linguistics linguistics library folia machine-learning language-modelling search-algorithms evaluation-metrics text-processing nlp-library natural-language-processing
Language:Python 477
pyarabic
linuxscout / pyarabic
pyarabic
arabic-language nlp-library text-processing
Language:Python 426
CAMeL-Lab / camel_tools
A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.
morphological-analysis nlp nlp-library nlp-apis arabic dialect-identification sentiment-analysis named-entity-recognition stemming pos-tagging arabic-dialects morphological-generation morphological-disambiguation morphological-reinflection
Language:Python 390
WorksApplications / SudachiPy
Python version of Sudachi, a Japanese tokenizer.
nlp-library morphological-analysis segmentation pos-tagging
Language:Python 377
nagisa
taishi-i / nagisa
A Japanese tokenizer based on recurrent neural networks
dynet word-segmentation pos-tagging japanese nlp-library sequence-labeling natural-language-processing nlp tokenizer
Language:Python 375
hellohaptik / multi-task-NLP
multi_task_NLP is a utility toolkit enabling NLP developers to easily train and infer a single model for multiple tasks.
pytorch multitask-learning sentence-classification sequence-labeling entailment ranking intent-classification named-entity-recognition machine-comprehension context-awareness transformers nlp nlp-library nli-tasks nlp-datasets nlp-apis
Language:Python 363
NLP-Natural-Language-Processing
ElizaLo / NLP-Natural-Language-Processing
Projects and useful articles / links
articles awesome awesome-list awesome-natural-language-processing awesome-nlp coursera-course coursera-data-science coursera-machine-learning deep-learning google-colaboratory machine-learning natural-language natural-language-processing natural-language-understanding naturallanguageprocessing nlp nlp-library nlp-machine-learning nlp-resources paper
Language:Jupyter Notebook 334