Giters

mana-ysh / many_tokenizer_as_one_model

Jointly Learning multi-criterion tokenizer via Neural Sequence Tagger

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

many_tokenizer_as_one_model

About

Jointly Learning multi-criterion tokenizer via Neural Sequence Tagger

License:Apache License 2.0

Languages

Language:Python 72.9%Language:Jupyter Notebook 21.4%Language:Jsonnet 4.0%Language:Makefile 1.7%