kofny / bpegen

Generating BPE PCFG model in binary format based on the plaintext version

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

bpegen

This project read in the plaintext BPE PCFG model and then generate binary-format model.

About

Generating BPE PCFG model in binary format based on the plaintext version


Languages

Language:Python 100.0%