Beast code in Giters

daac-tools's repositories

🎤 vibrato: Viterbi-based accelerated tokenizer

Language:RustApache-2.0301 7 19

🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer

Language:RustApache-2.0217 3 5

🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.

Language:RustApache-2.0189 3 5

Finding all pairs of similar documents time- and memory-efficiently

Language:RustApache-2.056 2 1

Viterbi-based accelerated tokenizer (Python wrapper)

Language:RustApache-2.034 2 1

Fast match expression optimized for string comparison

Language:RustApache-2.031 3 1

🦞 Rust library of natural language dictionaries using character-wise double-array tries.

Language:RustApache-2.027 2 2

🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.

Language:RustApache-2.020 2 1

🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)

Language:RustApache-2.013 10

Includes a file with zstd compression in Rust

Language:RustApache-2.09 20

Conditional Random Fields implemented in pure Rust

Language:RustApache-2.06 20

Guidelines for daac-tools community

020

Tokenization models and training scripts for Vaporetto fast tokenizer

Language:RustApache-2.0020