belladoreai / llama-tokenizer-js

JS tokenizer for LLaMA 1 and 2

Home Page:https://belladoreai.github.io/llama-tokenizer-js/example-demo/build/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

`performance` not available

imoneoi opened this issue · comments

commented

The performance is not always available, such as in the Next.js environment. I created a fix to only use it when necessary.

#7

Thank you for spotting the issue and thank you for writing the fix!

Your fix is now released in v1.1.2