Giters

vforteli / WordPieceTokenizer

WordPiece tokenizer for dotnet (eg with ML.Net)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

bertdotnetllmmlnettokenizer

WordPieceTokenizer for dotnet

About

WordPiece tokenizer for dotnet (eg with ML.Net)

bertdotnetllmmlnettokenizer

License:MIT License

Languages

Language:C# 100.0%