nlp-library

There are 40 repositories under nlp-library topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
nlp natural-language-processing pytorch language-model tensorflow bert language-models pytorch-transformers nlp-library transformer model-hub pretrained-models jax flax seq2seq speech-recognition hacktoberfest python machine-learning deep-learning
Language:Python 126115
explosion / spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
natural-language-processing data-science machine-learning python cython nlp artificial-intelligence ai spacy nlp-library neural-network neural-networks deep-learning named-entity-recognition entity-linking text-classification tokenization
Language:Python 28865
bharathgs / Awesome-pytorch-list
A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.
pytorch python machine-learning deep-learning tutorials papers awesome awesome-list pytorch-tutorials data-science nlp nlp-library cv computer-vision natural-language-processing facebook probabilistic-programming utility-library neural-network pytorch-model
14994
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
nlp pre-trained-language-models ai nlp-machine-learning natural-language-processing natural-language-understanding deep-learning pre-trained-model nlp-library pytorch transformer prompt prompt-toolkit prompts prompt-based-tuning prompt-learning
Language:Python 4172
fastnlp / fastNLP
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
natural-language-processing deep-learning nlp-library nlp-parsing chinese-nlp text-classification text-processing
Language:Python 3035
FudanNLP / fnlp
中文自然语言处理工具包 Toolkit for Chinese natural language processing
fudannlp fnlp java nlp-library
Language:Java 2639
FARM
deepset-ai / FARM
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
language-models bert nlp deep-learning transfer-learning pytorch nlp-library nlp-framework xlnet-pytorch ner question-answering pretrained-models roberta germanbert
Language:Python 1728
xavier-zy / Awesome-pytorch-list-CNVersion
Awesome-pytorch-list 翻译工作进行中......
pytorch python machine-learning deep-learning tutorials papers pytorch-tutorials data-sicence nlp nlp-library cv computer-vision facebook probabilistic-programming utility-library neural-network pytorch-models awsome-pytorch-list cnversion
Language:Jupyter Notebook 1705
chrismattmann / tika-python
Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
tika-server python tika-python tika-server-jar parser-interface parse translation-interface usc text-extraction mime buffer memex text-recognition detection recognition nlp nlp-machine-learning nlp-library covid-19 extraction
Language:Python 1425
underthesea
undertheseanlp / underthesea
Underthesea - Vietnamese NLP Toolkit
nlp nlp-library vietnamese-nlp vietnamese natural-language-processing vietnamese-tokenizer word-segmenter sentence-segmentation named-entity-recognition ner dependency-parsing pos-tagging dependency-parser
Language:Python 1320
MilaNLProc / contextualized-topic-models
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).
topic-modeling bert transformer embeddings text-as-data topic-coherence multilingual-topic-models multilingual-models neural-topic-models nlp nlp-library nlp-machine-learning
Language:Python 1170
thunlp / OpenDelta
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
nlp nlp-library pretrained-language-model parameter-efficient-learning deep-learning
Language:Python 942
atilika / kuromoji
Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search
japanese morphological-analyser nlp-library part-of-speech-tagger
Language:Java 930
PyThaiNLP / pythainlp
Thai Natural Language Processing in Python.
python thai-nlp nlp-library thai-language natural-language-processing thai-nlp-library thai-soundex soundex word-segmentation thai hacktoberfest hacktoberfest-accepted
Language:Python 929
NorskRegnesentral / skweak
skweak: A software toolkit for weak supervision applied to NLP tasks
weak-supervision nlp-machine-learning distant-supervision nlp-library spacy python data-science training-data natural-language-processing
Language:Python 911
ashishpatel26 / Treasure-of-Transformers
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
transformer python nlp natural-language-processing tensorflow pytorch speech-recognition seq2seq pretrained-models language-models natural-language-generation nlp-library bert natural-language-understanding language-model pytorch-transformers model-hub jax awesome
Language:Jupyter Notebook 848
mocobeta / janome
Japanese morphological analysis engine written in pure Python
python nlp-library japanese-language
Language:Python 828
ikawaha / kagome
Self-contained Japanese Morphological Analyzer written in pure Go
japanese tokenizer nlp-library japanese-language pos-tagging segmentation morphological-analysis korean hacktoberfest
Language:Go 790
WorksApplications / Sudachi
A Japanese Tokenizer for Business
morphological-analysis segmentation nlp-library pos-tagging
Language:Java 745
OCTIS
MIND-Lab / OCTIS
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
topic-modeling latent-dirichlet-allocation latent-semantic-analysis evaluation-metrics natural-language-processing non-negative-matrix-factorization neural-topic-models bayesian-optimization hyperparameter-optimization hyperparameter-tuning hyperparameter-search topic-models nlp nlproc nlp-library
Language:Python 688
DataDreamer
datadreamer-dev / DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
deep-learning machine-learning natural-language-processing nlp nlp-library python pytorch transformers alignment fine-tuning gpt instruction-tuning llm llmops llms openai synthetic-data synthetic-dataset-generation
Language:Python 672
cbaziotis / ekphrasis
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
nlp text-processing nlp-library spelling-correction tokenizer tokenization word-segmentation word-normalization spell-corrector text-segmentation semeval
Language:Python 660
lingua
pemistahl / lingua
The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike
language-detection language-processing kotlin-library java-library nlp-library nlp nlp-machine-learning natural-language natural-language-processing android-library language-identification language-classification language-recognition
Language:Kotlin 659
wyounas / homer
Homer, a text analyser in Python, can help make your text more clear, simple and useful for your readers.
python python3 python-library text-analysis python-script nlp nlp-library
Language:Python 632
Ailln / cn2an
📦 快速转化「中文数字」和「阿拉伯数字」～ (最新特性：分数，日期、温度等转化）
arabic-numerals chinese-numerals python arabic-numbers nlp-tool nlp-library speech-recognition asr pypi cn2an
Language:Python 609
taishi-i / awesome-japanese-nlp-resources
A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese
awesome japanese natural-language-processing nlp nlp-library japanese-language awesome-list cc0 llm
594
mindspore-lab / mindnlp
Easy-to-use and high-performance NLP and LLM framework based on MindSpore, compatible with models and datasets of 🤗Huggingface.
mindspore natural-language-processing nlp nlp-library deep-learning python large-language-models llm
Language:Python 517
fhamborg / Giveme5W1H
Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?
question answering news event-detection event-extraction fivewoneh fivew 5w1h 5w question-answering news-articles text-analysis nlp nlp-library
Language:HTML 501
medspacy / medspacy
Library for clinical NLP with spaCy.
nlp nlp-library spacy clinical-nlp pipeline medspacy
Language:Jupyter Notebook 479
proycon / pynlpl
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).
nlp python computational-linguistics linguistics library folia machine-learning language-modelling search-algorithms evaluation-metrics text-processing nlp-library natural-language-processing
Language:Python 477
pyarabic
linuxscout / pyarabic
pyarabic
nlp-library arabic-language text-processing
Language:Python 422
CAMeL-Lab / camel_tools
A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.
morphological-analysis nlp nlp-library nlp-apis arabic dialect-identification sentiment-analysis named-entity-recognition stemming pos-tagging arabic-dialects morphological-generation morphological-disambiguation morphological-reinflection
Language:Python 380
nagisa
taishi-i / nagisa
A Japanese tokenizer based on recurrent neural networks
dynet word-segmentation pos-tagging japanese nlp-library sequence-labeling natural-language-processing nlp tokenizer
Language:Python 376
WorksApplications / SudachiPy
Python version of Sudachi, a Japanese tokenizer.
nlp-library morphological-analysis segmentation pos-tagging
Language:Python 373
hellohaptik / multi-task-NLP
multi_task_NLP is a utility toolkit enabling NLP developers to easily train and infer a single model for multiple tasks.
pytorch multitask-learning sentence-classification sequence-labeling entailment ranking intent-classification named-entity-recognition machine-comprehension context-awareness transformers nlp nlp-library nli-tasks nlp-datasets nlp-apis
Language:Python 362
IBM / zshot
Zero and Few shot named entity & relationships recognition
few-shot few-shot-learning ned ner relation-extraction zero-shot zero-shot-learning spacy nlp ai deep-learning machine-learning named-entity-recognition natural-language-processing natural-language-understanding nlp-library pytorch relationship-extraction transformer
Language:Python 324