sentence-splitting

There are 4 repositories under sentence-splitting topic.

adobe / NLP-Cube
Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing
embeddings parse nlp-cube language-pipeline tokenization sentence-splitting part-of-speech-tagger lemmatization dependency-parser dependency-parsing universal-dependencies machine-translation information-extraction
Language:HTML 555
erre-quadro / spikex
SpikeX - SpaCy Pipes for Knowledge Extraction
abbreviations-detection acronym-recognition clustering entity-linking named-entity-recognition nlp noun-phrase-extract sentence-splitting spacy spacy-pipes verb-phrase-extract wikigraph wikipedia wikipedia-graph
Language:Python 398
vnlp
vngrs-ai / vnlp
State-of-the-art, lightweight NLP tools for Turkish language. Developed by VNGRS.
nlp turkish-nlp stemming morphological-analysis morphological-disambiguation named-entity-recognition dependency-parsing part-of-speech-tagging sentiment-analysis spelling-correction number-to-words deasciifier normalization stopword-removal sentence-tokenizer sentence-splitting word-embeddings word2vec fasttext deep-learning
Language:Python 252
mediacloud / sentence-splitter
Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
nlp sentence-splitting tokenizer
Language:Python 230
Prismadic / magnet
the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
embeddings fine-tuning finetuning-llms llm-training sentence-splitting tokenizers langchain mistral milvus nats nats-messaging nats-streaming apple-silicon huggingface inference-api mlx distributed-computing distributed-systems claude gemini
Language:Python 27
zaemyung / sentsplit
A flexible sentence segmentation library using CRF model and regex rules
sentence-segmentation sentence-splitting natural-language-processing sentence-boundary-detection
Language:Python 24
gosbd
gosbd / gosbd
A sentence splitting (sentence boundary disambiguation) library for Go. It is rule-based and works out-of-the-box.
natural-language-processing nlp-library sentence-boundary-detection sentence-tokenizer golang sentence-segmentation sentence-segmenter ai rag text-splitter text-splitting llm retrieval-augmented-generation sentence-splitter sentence-splitting
Language:Go 16
astariul / Sentencize.jl
Smallish library for sentence splitting in Julia
julia sentence-splitting sentence-splitter regex sentences sentence language nlp english linguistics hacktoberfest
Language:Julia 4
KorAP / Datok
High-Performance Finite State Tokenizer
nlp sentence-splitting tokenizer
Language:Go 4
mbanon / benchmarks
Several benchmarks on sentence splitting and language identification
benchmark language-identification nlp sentence-segmentation sentence-splitting
Language:Mathematica 3
M4t1ss / chunker
A sentence chunker PHP class + visualizer for Berkeley Parser parse trees
chunker syntactic-parser sentence-chunking sentence-splitting
Language:PHP 2
ptts-easy / text-classification-analyser
Sentence split, Text classfication, performanc analysis for NLP
classifier nlp sentence-classification sentence-splitting splitter text-classification
Language:JavaScript 2
kimryan / Lingua-EN-Sentence
split text into sentences (a Perl module)
nlp-parsing sentence-splitting text-analysis tokenizer
Language:Perl 1
ZJaume / splitters
A CLI for Rust SRX sentence segmenation rules as Python package.
rust sentence-segmentation srx pypi python sentence-splitter sentence-splitting
Language:Rust