Giters

mlc-ai / web-llm

High-performance In-browser LLM Inference Engine

Home Page:https://webllm.mlc.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[BUG] Cannot find global function vm.builtin.apply_presence_and_frequency_penalty

DavidGOrtega opened this issue · comments

commented

I have updated to latest version and my models are throwing this error:

Init error, Error: Cannot find global function vm.builtin.apply_presence_and_frequency_penalty

Last known version that worked for me was v0.2.18

commented

Hi! Are the models from https://github.com/mlc-ai/binary-mlc-llm-libs or did you compile the models yourself? If it is the latter case, you'd have to recompile them like here mlc-ai/binary-mlc-llm-libs#90. If it is the former case, you'd need to delete the cached model library from cache (there is a new API for this #314; or you could do it in browser's console) so that the new model library could be downloaded.

commented

@CharlieFRuan if I try to use the version v0.2.18 that was working for me previously I have the same error!!!
Should not TVMjs be pinned?

commented

Hmm this is not really expected as I only added apply_presence_and_frequency_penalty in #299.

commented

@CharlieFRuan my fault. I was not pinning exactly and was downloading .23 : 🙏