text-normalization

There are 10 repositories under text-normalization topic.

jfilter / clean-text
🧹 Python package for text cleaning
natural-language-processing nlp python python-package scraping text-cleaning text-normalization text-preprocessing user-generated-content
Language:Python 997
speechio / chinese_text_normalization
Chinese text normalization for speech processing
text-normalization chinese asr kaldi-asr thrax-gramma sparrowhawk speech-recognition
Language:Python 712
NVIDIA / NeMo-text-processing
NeMo text processing for ASR and TTS
inverse-text-n text-normalization
Language:Python 384
ikegami-yukino / neologdn
Japanese text normalizer for mecab-neologd
preprocessing nlp japanese-language mecab-ipadic-neologd text-normalization
Language:Cython 285
snakers4 / russian_stt_text_normalization
Russian text normalization pipeline for speech-to-text and other applications based on tagging s2s networks
speech russian-language python3 pytorch torchscript text-normalization speech-to-text
Language:Python 121
greenlikeorange / knayi-myscript
Myanmar Language Script Library
myanmar unicode zawgyi text-normalization burmese-nlp fontconvert fontdetect
Language:JavaScript 77
cognibit / Text-Normalization-Demo
Demonstration of the results in "Text Normalization using Memory Augmented Neural Networks", Authors: Subhojeet Pramanik, Aman Hussain
sequence-dnc paper text-normalization differentiable-neural-computer recurrent-neural-networks results text-to-speech deep-learning tensorflow
Language:Jupyter Notebook 60
Isminoula / TextNormSeq2Seq
Code and model files for paper: I. Lourentzou et al., Adapting Sequence to Sequence models for Text Normalization in Social Media", ICWSM'19
text-normalization tweets seq2seq pytorch sequence-to-sequence encoder-decoder deep-learning
Language:Python 37
csebuetnlp / normalizer
This python module is an easy-to-use port of the text normalization used in the paper "Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali-English machine translation". It is intended to be used for normalizing / cleaning Bengali and English text.
text-processing text-preprocessing text-normalization bangla-text-normalization bengali-text-normalization
Language:Python 34
tomaarsen / TTSTextNormalization
Convert English text from written expressions into spoken forms
spoken-forms competition tts text-normalization normalization nlp
Language:Python 27
kscanne / caighdean
Inneall aistriúcháin atá taobh thiar de Chaighdeánaitheoir na Gaeilge, agus aistritheoirí Gàidhlig/Gaelg→Gaeilge
gaeilge gaelg-gaeilge gaidhlig gaelg translation text-normalization irish gaelic
Language:Perl 20
ducnt18121997 / Viet-Text-Normalization
A Python library for text normalization, specifically designed for Vietnamese and English text processing. This library provides comprehensive text normalization capabilities including handling of special characters, numbers, dates, and various text formats.
nlp regrex text-normalization text-to-speech
Language:Python 12
sugatagh / E-commerce-Text-Classification
Proper categorization of e-commerce products enhances the user experience and achieves better results with external search engines. The objective of the project is to classify a product into four given categories, based on its description available on an e-commerce platform.
e-commerce natural-language-processing product-categorization text-classification text-normalization tf-idf word2vec
Language:Jupyter Notebook 12
ecomp-shONgit / text-normalisation
JS / Python3 / PHP Lib to work with UTF8 polytonic greek and latin
polytonic-greek-and-latin text-normalization romanization greek-latin greek-trasliteration text-cleaning
Language:JavaScript 10
seanghay / tha
📢 Tha (ថា) - A Khmer Text Normalization and Verbalization Toolkit
cambodia khmer khmer-language text-normalization text-verbalization
Language:Python 9
312shan / Text-Normalization-in-pyTorch
pyTorch implementation for Text Normalization Challenge
attention-mechanism pytorch seq2seq text-normalization
Language:Jupyter Notebook 8
esentis / string_extensions
Useful String extensions to save you time in production.
string-extensions flutter-plugin flutter dartlang text-normalization string-manipulation string-formatter string-validation string-normalization string-matching dart-string-manipulation string strings
Language:Dart 7
cewarman / NTPU_online_text_normalization
An online text normalization tool for Chinese-English mixed text-to-speech system
text-to-speech rule-based text-normalization english traditional-chinese online mandarin chinese
Language:Python 5
rafalposwiata / text-normalization
Repository for text normalization research.
natural-language-processing numbers-to-text polish-language text-normalization text-to-speech
5
digitalcortex / newline_normalizer
Fast, precise normalization of Unix and DOS newline formats in Rust.
newline rust rust-crate text text-normalization unix windows
Language:Rust 4
vinhdq842 / soe-vinorm
Soe Vinorm: An Effective Text Normalization Toolkit for converting Vietnamese text to its spoken form.
nlp-library text-normalization vietnamese-nlp
Language:Python 4
ZRktty / accent-folding
A JavaScript library for accent-insensitive text processing, including accent folding and search term highlighting
accent-removal javascript-library npm-package search-highlight string-manipulation text-normalization text-processing accent-folding accent-insensitive
Language:JavaScript 4
ajaytiwari0210 / Normalization-of-Social-Media-Text
neural-network sequence-to-sequence nlp-machine-learning spelling-correction text-normalization
3
biswaup / soft_TF_IDF-and-Blocking
blocking nlp soft-tf-idf string-matching text-normalization
Language:Python 3
cadia-lvl / althingi-asr
An ASR recipe and speech corpus of Icelandic parliamentary speeches
kaldi-asr althingi text-normalization icelandic speech-recognition
Language:Shell 3
davedean / deslopify
A utility that cleans up text by removing or translating common 'slop' patterns from AI-generated text
ai ai-slop slop ai-text cli formatting llm node npm-package text-normalization text-processing typescript utility
Language:TypeScript 3
gokhaneraslan / tacotron2-tts-training
Training Tacotron 2 Text-to-Speech (TTS)
custom-dataset fine-tuning multiple-language-support tacotron2 text-normalization training transfer-learning tts turkish
Language:Python 3
khanhtran2000 / FPT.AI_2020
My work during internship at FPT.AI 2020
artificial-intelligence bio-tagging collection deep-learning internship nlp text-normalization word-embeddings word-segmentation
Language:Jupyter Notebook 3
kscanne / droichead
Nascanna idir Foclóir Uí Dhónaill agus DIL
irish gaeilge old-irish sean-ghaeilge dictionary text-normalization etymology
Language:HTML 3
princ3od / VietnamNumber
Library supports converting number to Vietnamese for .NET C# ./
vietnamese number csharp nuget text-normalization
Language:C# 3
stefantaubert / english-text-normalization
Command-line interface (CLI) and library to normalize English texts.
nlp preprocessing text-normalization tts
Language:Python 3
vietbtx / ViTextnormASR
Our source code for the paper "Transformer-based Joint Learning Approach for Text Normalization in Vietnamese ASR"
automatic-speech-recognition joint-learning natural-language-processing text-normalization
Language:Python 3
Agash / TTSTextNormalization
Modern .NET 9 / C# 13 library to normalize text (emojis, currency, numbers, abbreviations, chat slang) for consistent and natural Text-to-Speech (TTS) synthesis, ideal for stream chat/donations.
dotnet speech-synthesis streaming text-normalization text-to-speech tts twitch youtube
Language:C# 2
areeba0 / English-to-French-Translation-using-NLTK-and-Hugging-Face-Transformers-MarianMTModel
This repository provides a complete workflow for text processing using Hugging Face Transformers and NLTK. It includes modules for sentence normalization, spelling correction, word embedding generation, positional encoding computation, and English-to-French translation
huggingface-transformers jupyter-notebook nlp nltk positional-encoding python text-normalization word-embeddings english-to-french-translation
Language:Jupyter Notebook 2
Seavleu / khmer-utils
A 🇰🇭 utility library for number formatting, currency display, date localization, text normalization, and script transliteration, built for Cambodian developers.
currency-conversion khmer-language locale number-formatting text-normalization transliteration date-localization
Language:JavaScript 2
techecosystem / parsify-php
A PHP library for Persian text conversion, including number translation, diacritics removal, and normalization with a fluent API.
persian persian-language php php-library text-conversion text-normalization text-utilities
Language:PHP 2

text-normalization

jfilter / clean-text

speechio / chinese_text_normalization

NVIDIA / NeMo-text-processing

ikegami-yukino / neologdn

snakers4 / russian_stt_text_normalization

greenlikeorange / knayi-myscript

cognibit / Text-Normalization-Demo

Isminoula / TextNormSeq2Seq

csebuetnlp / normalizer

tomaarsen / TTSTextNormalization

kscanne / caighdean

ducnt18121997 / Viet-Text-Normalization

sugatagh / E-commerce-Text-Classification

ecomp-shONgit / text-normalisation

seanghay / tha

312shan / Text-Normalization-in-pyTorch

esentis / string_extensions

cewarman / NTPU_online_text_normalization

rafalposwiata / text-normalization

digitalcortex / newline_normalizer

vinhdq842 / soe-vinorm

ZRktty / accent-folding

ajaytiwari0210 / Normalization-of-Social-Media-Text

biswaup / soft_TF_IDF-and-Blocking

cadia-lvl / althingi-asr

davedean / deslopify

gokhaneraslan / tacotron2-tts-training

khanhtran2000 / FPT.AI_2020

kscanne / droichead

princ3od / VietnamNumber

stefantaubert / english-text-normalization

vietbtx / ViTextnormASR

Agash / TTSTextNormalization

areeba0 / English-to-French-Translation-using-NLTK-and-Hugging-Face-Transformers-MarianMTModel

Seavleu / khmer-utils

techecosystem / parsify-php