language-identification

There are 7 repositories under language-identification topic.

googlesamples / mlkit
A collection of sample apps to demonstrate how to use Google's ML Kit APIs on Android and iOS
barcode barcode-scanner face-detection google image-labeling language-identification ml-kit mlkit mlkit-android object-detection smart-reply text-recognition translation
Language:Java 3464
lingua-go
pemistahl / lingua-go
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
natural-language-processing language-detection language-recognition language-classification language-identification language-processing nlp nlp-machine-learning golang-library go language-modeling text-processing
Language:Go 1129
lingua-py
pemistahl / lingua-py
The most accurate natural language detection library for Python, suitable for short text and mixed-language text
nlp natural-language-processing language-detection language-recognition language-identification language-classification python-library
Language:Python 1031
modelscope / 3D-Speaker
A Repository for Single- and Multi-modal Speaker Verification, Speaker Recognition and Speaker Diarization
campplus speaker-diarization speaker-verification voxceleb 3d-speaker eres2net rdino language-identification modelscope cnceleb
Language:Python 951
lingua-rs
pemistahl / lingua-rs
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
rust rust-library rust-crate language-detection language-classification language-recognition natural-language-processing nlp language-identification nlp-machine-learning language-processing
Language:Rust 855
lingua
pemistahl / lingua
The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike
language-detection language-processing kotlin-library java-library nlp-library nlp nlp-machine-learning natural-language natural-language-processing android-library language-identification language-classification language-recognition
Language:Kotlin 675
apcode / tensorflow_fasttext
Simple embedding based text classifier inspired by fastText, implemented in tensorflow
fasttext language-identification tensorflow text-classifier
Language:Python 302
textpipe / textpipe
Textpipe: clean and extract metadata from text
nlp named-entities named-entity-recognition text-processing text-analysis language-identification
Language:Python 300
vunb / vntk
Vietnamese NLP Toolkit for Node
vietnamese-nlp vietnamese-tokenizer natural-language-processing vietnamese vietnamese-text-classification language-identification named-entity-recognition tf-idf pos-tagging
Language:JavaScript 213
echogarden-project / echogarden
Easy-to-use speech toolset. Written in TypeScript. Includes tools for synthesis, recognition, alignment, speech translation, language detection, source separation and more.
forced-alignment language-identification speech speech-alignment speech-recognition speech-synthesis speech-to-text speech-translation text-to-speech language-detection source-separation
Language:TypeScript 146
adbar / simplemma
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
nlp lemmatization lemmatizer lemmatiser tokenization wordlist morphological-analysis corpus-tools tokenizer low-resource-nlp language-detection language-identification
Language:Python 134
HPI-DeepLearning / crnn-lid
Code for the paper Language Identification Using Deep Convolutional Recurrent Neural Networks
cnns computer-vision deep-learning keras language-identification
Language:Python 105
KrishnaDN / x-vector-pytorch
Implementation of the paper "Spoken Language Recognition using X-vectors" in Pytorch
x-vector x-vector-pytorch language-recognition language-identification speech
Language:Python 99
LlmKira / fast-langdetect
⚡️ 80x faster language detection with Fasttext | Split text by language for TTS
fasttext i18n detect-languages languagedetector language-identification svc tts
Language:Python 81
cisnlp / GlotLID
GlotLID: Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
language-detection language-detection-lib language-detection-library language-detector language-identification language-identification-toolkit language-identifier langid lid low-resource-languages low-resource-nlp multlingual language-classification language-recognition glot
Language:Python 79
SpeechFlow-io / Spoken_language_identification
A TensorFlow-based spoken language identification
python speech tensorflow cnn language-identification language-recognition spoken-language-recognition
Language:Python 77
swshon / dialectID_e2e
End to End Dialect Identification using Convolutional Neural Network
dialect identification langugage-recognition i-vector dialectal speech mgb3 mgbchallenge multi-genre arabic arabic-language language-identification recognition dnn cnn lre sre
Language:Python 51
microsoft / LID-tool
This code provides word level language identification tool for identifying language for individual words in Code-Mixed text. e.g. The text that includes words from two languages such as Hindi written in roman script, mixed with English.
language-identification natural-language-processing python3 mallet language-tags code-mixing code-switching linguistics
Language:Python 48
py-lidbox / lidbox
End-to-end spoken language identification out of the box.
language-recognition language-identification tensorflow spoken-language-recognition spoken-language-identification audio-analysis speech deep-learning big-data
Language:Python 48
adbar / py3langid
Faster, modernized fork of the language identification tool langid.py
detect-language langid language-detection language-identification language-recognition nlp whatlang
Language:Python 43
nitotm / efficient-language-detector
Fast and accurate natural language detection. Detector written in PHP. Nito-ELD, ELD.
language language-detection language-detector language-identification natural-language natural-language-processing nlp php
Language:PHP 40
rosette-api / python
Rosette API Client Library for Python
nlp machine-learning natural-language-processing text-analysis python entity-extraction name-generation language-detection language-identification categorization tokenization morphology lemmatization relation-extraction name-translation name-similarity sentiment-analysis text text-mining fuzzy-matching
Language:Python 37
currentslab / fastlangid
fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-hant)
cantonese-language traditional-chinese simplified-chinese identification fasttext language-identification language-identifier
Language:Python 35
zkmkarlsruhe / language-identification
Spoken Language Identification on Common Voice and AudioSet using Deep Learning
spoken-language-identification language-identification lid common-voice audioset intelligent-museum zkm
Language:Python 35
sagorbrur / codeswitch
CodeSwitch is a NLP tool, can use for language identification, pos tagging, name entity recognition, sentiment analysis of code mixed data.
codeswitch code-mixed nlp pos ner code-switching hindi-english spanish-english pos-tagging language-identification sentiment-analysis huggingface transformers
Language:Jupyter Notebook 29
hiredscorelabs / seqtolang
Multi-Langauge Identification
deep-learning language-identification machine-learning natural-language-processing
Language:Python 28
nipunmanral / Spoken-Language-Identification
Implement a GRU/LSTM model using Keras, and train it to classify the languages using MFCC features
gru lstm deep-learning neural-networks keras language-identification mfcc
Language:Python 26
mbanon / fastspell
Targetted language identifier, based on FastText and Hunspell.
fasttext hunspell language-identification nlp
Language:Python 25
UBC-NLP / afrolid
AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
african-languages deep-learning dlnlp language-identification natural-langauge-processing nlp toolkit ubc-nlp
Language:Python 25
dss-plugin-nlp-preparation
dataiku / dss-plugin-nlp-preparation
Dataiku DSS plugin to detect languages, correct misspellings, and clean text data 🧼
auto-correct dataiku dss-plugin language-detection language-identification natural-language-processing nlp spell-checker text-cleaning
Language:Python 23
nitotm / efficient-language-detector-js
Fast and accurate natural language detection. Detector written in Javascript. Nito-ELD, ELD.
javascript language language-detection language-detector language-identification natural-language natural-language-processing nlp nodejs
Language:JavaScript 23
floydhub / language-identification-template
Detect the languages from short pieces of text
floydhub language-identification language-detection keras tensorflow nlp neural-network deep-learning machine-learning
Language:Jupyter Notebook 22
igorsitdikov / lid_kaldi
language-recognition language-identification spoken-language-recognition spoken-language-identification kaldi kaldi-asr
Language:C++ 22
smola / language-dataset
Dataset for programming language identification.
dataset language-detection language-identification programming-language-identification
Language:Python 21
joshdevins / demo-es-lang-ident
Demo: Elasticsearch Language Identification
demo elasticsearch language-identification nlp search
Language:Python 19
MartinThoma / lidtk
Language Identification Toolkit
language-identification python-3 python-3-5 mit-license language-identification-toolkit machine-learning nlp nlp-machine-learning
Language:Python 18