nlp-library

There are 44 repositories under nlp-library topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
bert deep-learning flax hacktoberfest jax language-model language-models machine-learning model-hub natural-language-processing nlp nlp-library pretrained-models python pytorch pytorch-transformers seq2seq speech-recognition tensorflow transformer
Language:Python 135909
explosion / spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
ai artificial-intelligence cython data-science deep-learning entity-linking machine-learning named-entity-recognition natural-language-processing neural-network neural-networks nlp nlp-library python spacy text-classification tokenization
Language:Python 30398
bharathgs / Awesome-pytorch-list
A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.
awesome awesome-list computer-vision cv data-science deep-learning facebook machine-learning natural-language-processing neural-network nlp nlp-library papers probabilistic-programming python pytorch pytorch-model pytorch-tutorials tutorials utility-library
15527
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
ai deep-learning natural-language-processing natural-language-understanding nlp nlp-library nlp-machine-learning pre-trained-language-models pre-trained-model prompt prompt-based-tuning prompt-learning prompt-toolkit prompts pytorch transformer
Language:Python 4388
fastnlp / fastNLP
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
chinese-nlp deep-learning natural-language-processing nlp-library nlp-parsing text-classification text-processing
Language:Python 3073
FudanNLP / fnlp
中文自然语言处理工具包 Toolkit for Chinese natural language processing
fnlp fudannlp java nlp-library
Language:Java 2650
FARM
deepset-ai / FARM
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
bert deep-learning germanbert language-models ner nlp nlp-framework nlp-library pretrained-models pytorch question-answering roberta transfer-learning xlnet-pytorch
Language:Python 1742
xavier-zy / Awesome-pytorch-list-CNVersion
Awesome-pytorch-list 翻译工作进行中......
awsome-pytorch-list cnversion computer-vision cv data-sicence deep-learning facebook machine-learning neural-network nlp nlp-library papers probabilistic-programming python pytorch pytorch-models pytorch-tutorials tutorials utility-library
Language:Jupyter Notebook 1738
chrismattmann / tika-python
Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
buffer covid-19 detection extraction memex mime nlp nlp-library nlp-machine-learning parse parser-interface python recognition text-extraction text-recognition tika-python tika-server tika-server-jar translation-interface usc
Language:Python 1516
underthesea
undertheseanlp / underthesea
Underthesea - Vietnamese NLP Toolkit
dependency-parser dependency-parsing named-entity-recognition natural-language-processing ner nlp nlp-library pos-tagging sentence-segmentation vietnamese vietnamese-nlp vietnamese-tokenizer word-segmenter
Language:Python 1429
MilaNLProc / contextualized-topic-models
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).
bert embeddings multilingual-models multilingual-topic-models neural-topic-models nlp nlp-library nlp-machine-learning text-as-data topic-coherence topic-modeling transformer
Language:Python 1206
thunlp / OpenDelta
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
deep-learning nlp nlp-library parameter-efficient-learning pretrained-language-model
Language:Python 1006
PyThaiNLP / pythainlp
Thai natural language processing in Python
computational-linguistics hacktoberfest natural-language-processing nlp-library python soundex text-processing thai thai-language thai-nlp thai-nlp-library thai-soundex word-segmentation
Language:Python 989
atilika / kuromoji
Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search
japanese morphological-analyser nlp-library part-of-speech-tagger
Language:Java 960
ashishpatel26 / Treasure-of-Transformers
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
awesome bert jax language-model language-models model-hub natural-language-generation natural-language-processing natural-language-understanding nlp nlp-library pretrained-models python pytorch pytorch-transformers seq2seq speech-recognition tensorflow transformer
Language:Jupyter Notebook 933
NorskRegnesentral / skweak
skweak: A software toolkit for weak supervision applied to NLP tasks
data-science distant-supervision natural-language-processing nlp-library nlp-machine-learning python spacy training-data weak-supervision
Language:Python 921
DataDreamer
datadreamer-dev / DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
alignment deep-learning fine-tuning gpt instruction-tuning llm llmops llms machine-learning natural-language-processing nlp nlp-library openai python pytorch synthetic-data synthetic-dataset-generation transformers
Language:Python 858
mocobeta / janome
Japanese morphological analysis engine written in pure Python
python nlp-library japanese-language
Language:Python 858
ikawaha / kagome
Self-contained Japanese Morphological Analyzer written in pure Go
hacktoberfest japanese japanese-language korean morphological-analysis nlp-library pos-tagging segmentation tokenizer
Language:Go 829
WorksApplications / Sudachi
A Japanese Tokenizer for Business
morphological-analysis nlp-library pos-tagging segmentation
Language:Java 812
OCTIS
MIND-Lab / OCTIS
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
topic-modeling latent-dirichlet-allocation latent-semantic-analysis evaluation-metrics natural-language-processing non-negative-matrix-factorization neural-topic-models bayesian-optimization hyperparameter-optimization hyperparameter-tuning hyperparameter-search topic-models nlp nlproc nlp-library
Language:Python 734
mindspore-lab / mindnlp
Easy-to-use and high-performance NLP and LLM framework based on MindSpore, compatible with models and datasets of 🤗Huggingface.
deep-learning large-language-models llm mindspore natural-language-processing nlp nlp-library python
Language:Python 733
lingua
pemistahl / lingua
The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike
language-detection language-processing kotlin-library java-library nlp-library nlp nlp-machine-learning natural-language natural-language-processing android-library language-identification language-classification language-recognition
Language:Kotlin 713
taishi-i / awesome-japanese-nlp-resources
A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese
awesome japanese natural-language-processing nlp nlp-library japanese-language awesome-list cc0 llm
711
Ailln / cn2an
📦 快速转化「中文数字」和「阿拉伯数字」～ (最新特性：分数，日期、温度等转化）
arabic-numbers arabic-numerals asr chinese-numerals cn2an nlp-library nlp-tool pypi python speech-recognition
Language:Python 681
cbaziotis / ekphrasis
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
nlp nlp-library semeval spell-corrector spelling-correction text-processing text-segmentation tokenization tokenizer word-normalization word-segmentation
Language:Python 663
wyounas / homer
Homer, a text analyser in Python, can help make your text more clear, simple and useful for your readers.
nlp nlp-library python python-library python-script python3 text-analysis
Language:Python 633
medspacy / medspacy
Library for clinical NLP with spaCy.
nlp nlp-library spacy clinical-nlp pipeline medspacy
Language:Jupyter Notebook 537
fhamborg / Giveme5W1H
Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?
5w 5w1h answering event-detection event-extraction fivew fivewoneh news news-articles nlp nlp-library question question-answering text-analysis
Language:HTML 512
proycon / pynlpl
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).
nlp python computational-linguistics linguistics library folia machine-learning language-modelling search-algorithms evaluation-metrics text-processing nlp-library natural-language-processing
Language:Python 479
pyarabic
linuxscout / pyarabic
pyarabic
nlp-library arabic-language text-processing
Language:Python 451
CAMeL-Lab / camel_tools
A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.
morphological-analysis nlp nlp-library nlp-apis arabic dialect-identification sentiment-analysis named-entity-recognition stemming pos-tagging arabic-dialects morphological-generation morphological-disambiguation morphological-reinflection
Language:Python 416
WorksApplications / SudachiPy
Python version of Sudachi, a Japanese tokenizer.
morphological-analysis nlp-library pos-tagging segmentation
Language:Python 392
nagisa
taishi-i / nagisa
A Japanese tokenizer based on recurrent neural networks
dynet word-segmentation pos-tagging japanese nlp-library sequence-labeling natural-language-processing nlp tokenizer
Language:Python 391
NLP-Natural-Language-Processing
ElizaLo / NLP-Natural-Language-Processing
Projects and useful articles / links
nlp nlp-machine-learning machine-learning nlp-library articles natural-language-processing paper awesome awesome-list awesome-nlp google-colaboratory coursera-course coursera-data-science coursera-machine-learning deep-learning nlp-resources naturallanguageprocessing natural-language-understanding natural-language awesome-natural-language-processing
Language:Jupyter Notebook 378
hellohaptik / multi-task-NLP
multi_task_NLP is a utility toolkit enabling NLP developers to easily train and infer a single model for multiple tasks.
context-awareness entailment intent-classification machine-comprehension multitask-learning named-entity-recognition nli-tasks nlp nlp-apis nlp-datasets nlp-library pytorch ranking sentence-classification sequence-labeling transformers
Language:Python 372