Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.

Home Page:https://llamafile.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

No Penalize NL not found.

francisco-lafe opened this issue · comments

Hi, the output from the help states about the --no-penalize-nl command.
But it fails to load it.
image

you may try to pass this flag with .arg.

@jart would that be a good idea to cherry-pick this commit so the user can toggle this flag from the UI?

ggerganov/llama.cpp@2e66913

I double checked.
I must say that the server/cli being a single file needs a small revamp on the help docs.
Some commands are 'cli' only and others only make sense for the 'server' (http web interface), which in turns make it difficult to know what goes for what.