explosion / tokenizations

Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/

explosion/tokenizations Issues

Unable to install `pytokenizations` in Google Colab
Closed a year ago2
Add support to release linux aarch64 wheels
Closed 3 years ago2
nfkd -> lower instead of lower -> nfkd?
Closed 3 years ago1
Could not install on Jetson Nano aarch64 [SOLVED!]
Closed 3 years ago5
Dependabot can't resolve your Python dependency files
Closed 3 years ago
Dependabot can't resolve your Python dependency files
Closed 3 years ago
Cannot install with pip
Closed 4 years ago2
get_original_spans. A simple example with an error
Closed 4 years ago2
Dependabot couldn't authenticate with https://pypi.python.org/simple/
Closed 4 years ago
Compile for glibc 2.17
Closed 4 years ago4
Support type hints
Closed 4 years ago