lemmatization

There are 3 repositories under lemmatization topic.

roshan-research / hazm
Persian NLP Toolkit
natural-language-processing python persian nlp persian-nlp dependency-parser embeddings text-processing tokenizer lemmatization farsi normalization pos-tagging
Language:Python 1100
nlp-uoregon / trankit
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
nlp natural-language-processing pytorch language-model xlm-roberta machine-learning deeplearning artificial-intelligence universal-dependencies multilingual adapters sentence-segmentation tokenization part-of-speech-tagging morphological-tagging dependency-parsing lemmatization
Language:Python 705
adobe / NLP-Cube
Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing
embeddings parse nlp-cube language-pipeline tokenization sentence-splitting part-of-speech-tagger lemmatization dependency-parser dependency-parsing universal-dependencies machine-translation information-extraction
Language:HTML 551
CogComp / cogcomp-nlp
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
natural-language-processing nlp big-data data-mining cogcomp lemmatizer lemmatization tokenizer transliteration pos pos-tagging parts-of-speech-tagging ner named-entity-recognition relation-extraction dependency-parsing similarity natural-language-understanding
Language:Java 469
michmech / lemmatization-lists
Machine-readable lists of lemma-token pairs in 23 languages.
nlp lemmatization
301
nlpub / pymystem3
A Python wrapper of the Yandex Mystem 3.1 morphological analyzer (http://api.yandex.ru/mystem). The original tool is shipped as a binary and this library makes it easy to integrate it in Python projects. Let us know in the issues if you would like to be involved into the developments or maintenance of this project. If you have any fix or suggestion, please make a pull request. We are very open to accepting any contributions.
pos tagging tagger lemma lemmatization lemmatizer russian language morphology mystem yandex mystem3 morphological-analysis morphological-analyser
Language:Python 287
bjascob / LemmInflect
A python module for English lemmatization and inflection.
inflection lemmatization python spacy spacy-extensions nlp nlp-machine-learning
Language:Python 246
bnosac / udpipe
R package for Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing Based on the UDPipe Natural Language Processing Toolkit
conll dependency-parser lemmatization natural-language-processing nlp pos-tagging r r-package r-pkg rcpp text-mining tokenizer udpipe
Language:C++ 208
janlukasschroeder / nlp-cheat-sheet-python
NLP Cheat Sheet, Python, spacy, LexNPL, NLTK, tokenization, stemming, sentence detection, named entity recognition
spacy spacy-nlp cheat-sheet nlp python starter-kit introduction machine-learning tokenization lemmatization spans sentence-similarity pos-tagging dependency-parsing named-entity-recognition nltk lexnlp
Language:Jupyter Notebook 192
milaan9 / Python_Natural_Language_Processing
This repository consists of a complete guide on natural language processing (NLP) in Python where we'll learn various techniques for implementing NLP including parsing & text processing and understand how to use NLP for text feature engineering.
nlp tokenization stemming lemmatization stopwords partofspeech-tagger named-entity-recognition sentence-segmentation bag-of-words termfrequency inversedocumentfrequency tf-idf vocabulary-matching python4datascience python4everybody tutor-milaan9 ipython-notebook
Language:Jupyter Notebook 188
anujvyas / Natural-Language-Processing-Projects
This repository consists of all my NLP Projects
natural-language-processing nlp nltk python stemming lemmatization wordcloud text-classification sentiment-analysis
Language:Jupyter Notebook 154
huspacy
huspacy / huspacy
HuSpaCy: industrial-strength Hungarian natural language processing
hungarian hunlp nlp natural-language-processing spacy spacy-models pos-tagger dependency-parsing universal-dependencies information-extraction spacy-pipeline ner named-entity-recognition lemmatization huspacy morphological-analysis machine-learning python text-mining
Language:Python 147
adbar / simplemma
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
nlp lemmatization lemmatizer lemmatiser tokenization wordlist morphological-analysis corpus-tools tokenizer low-resource-nlp language-detection language-identification
Language:Python 125
biolab / orange3-text
🍊 :page_facing_up: Text Mining add-on for Orange3
orange text-mining text text-analysis sentiment-analysis twitter newspapers stopwords nltk lemmatization stemming bag-of-words
Language:Python 124
Qutuf
Qutuf / Qutuf
Qutuf (قُطُوْف): An Arabic Morphological analyzer and Part-Of-Speech tagger as an Expert System.
arabic part-of-speech-tagger pos-tagging stemmer stemming root-extraction arabic-nlp arabic-language morphological-analysis expert-system rooting light-stemming heavy-stemming pattern-matching premature-tagging overdue-tagging role-based lemmatization arabic-morphology arabic-tagger
Language:Python 123
vhyza / elasticsearch-analysis-lemmagen
Elasticsearch lemmatizer for 15 languages
elasticsearch-plugin analyzer java lemmatizer lemmatization elasticsearch
Language:Java 103
ianscottknight / Predicting-Myers-Briggs-Type-Indicator-with-Recurrent-Neural-Networks
myers-briggs mbti mbti-personality rnn recurrent-neural-networks keras keras-neural-networks trump-tweets trump predictive-modeling nlp nlp-machine-learning personality-traits social-media classification machine-learning textual-data tf-idf lemmatization
Language:Python 101
mit-ccc / TweebankNLP
An off-the-shelf pre-trained Tweet NLP Toolkit (NER, tokenization, lemmatization, POS tagging, dependency parsing) + Tweebank-NER dataset
nlp-toolkit ner tokenization lemmatization dependency-parser pos-tagging named-entity-recognition text-annotation twitter-nlp tweet-analysis machine-learning natural-language-processing
Language:Python 98
eellak / gsoc2018-spacy
[GSOC] Greek language support for spacy.io python NLP software
natural-language-processing python spacy greek gsoc-2018 greek-language lemmatization
Language:Python 95
explosion / spacy-lookups-data
📂 Additional lookup tables and data resources for spaCy
spacy nlp natural-language-processing machine-learning lemmatization
Language:Python 92
akoksal / Turkish-Lemmatizer
Lemmatization for Turkish Language
natural-language-processing python3 lemmatization lemmatizer turkish
Language:Python 89
WZBSocialScienceCenter / germalemma
A lemmatizer for German language text
german nlp language-processing lemmatizer lemmatization python
Language:Python 85
Koziev / GrammarEngine
Грамматический Словарь Русского Языка (+ английский, японский, etc)
nlp nlp-library nlp-parsing lemmatization lemmatizer morphological-analysis morphological-analyser russian-morphology machine-learning syntax-parser part-of-speech-tagger chunking
Language:C++ 73
tensordot / syntaxdot
Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.
dependency-parsing sequence-labels lemmatization xlm-roberta pretrained-models biaffine-parser bert part-of-speech-tagging morphology
Language:Rust 65
liuzl / ling
Natural Language Processing Toolkit in Golang
tokenization normalization lemmatization opencc nlp spacy corenlp
Language:Go 63
winkjs / wink-lemmatizer
English lemmatizer
lemmatization lemmatizer lemma nlp verb noun
Language:JavaScript 63
biblissima / collatinus
Sources of Collatinus software - Latin lemmatizer, morphological analyzer and scansion
lemmatizer latin morphological-analysis lemmatization latin-language
Language:JavaScript 60
xiamx / lemma
A Morphological Parser (Analyser) / Lemmatizer written in Elixir.
morphological-analyser nlp elixir morphology lemmatization lemmatizer erlang
Language:Elixir 49
trinker / textstem
Tools for fast text stemming & lemmatization
r lemmatization stemming text-mining
Language:R 43
zeyrek
obulat / zeyrek
Python morphological analyzer for Turkish language. Partial port of ZemberekNLP.
nlp morphology turkish lemmatization morphological-analysis
Language:Python 42
Koziev / rulemma
Лемматизатор для русскоязычных текстов
russian-language lemmatization lemmatizer nlp nlp-library natural-language-processing
Language:Python 40
rosette-api / python
Rosette API Client Library for Python
nlp machine-learning natural-language-processing text-analysis python entity-extraction name-generation language-detection language-identification categorization tokenization morphology lemmatization relation-extraction name-translation name-similarity sentiment-analysis text text-mining fuzzy-matching
Language:Python 37
bastienbot / nlp-js-tools-french
POS Tagger, lemmatizer and stemmer for french language in javascript
nlp postagging postgresql tokenizer tokenization stemming stemmer lemmatizer lemmatization
Language:JavaScript 36
Hyperparticle / LemmaTag
A neural network that jointly part-of-speech tags and lemmatizes sentences, boosting accuracy for morphologically-rich languages (Czech, Arabic, etc.)
nlp deep-learning tensorflow machine-learning neural-network pos-tagging lemmatization natural-language-processing
Language:Python 34
antixrist / node-phpmorphy
Полнофункциональный порт phpMorphy на Node.JS
javascript js lemmatiser lemmatization lemmatizer morphological-analyser morphological-analysis morphology node-js nodejs phpmorphy phpmorphy-node russian-specific
Language:JavaScript 33
amir-zeldes / HebPipe
An NLP pipeline for Hebrew
nlp hebrew hebrew-nlp universal-dependencies part-of-speech-tagger lemmatization morphological-analysis
Language:Lex 31