rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Home Page:https://docs.rs/llm/latest/llm/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How to disable ggml logging?

mrwilby opened this issue · comments

I read that when using metal acceleration, ggml may emit logging. How can we disable this? It's overwhelming all the other output from my program making it difficult to see what's important (to me).

During inferencing I see lines such as:

... ggml_metal_graph_compute_block_invoke: encoding node 543, op = MUL_MAT ...

Is it possible to disable this somehow?

The logging is generated from the ggml side and there is currently no way to disable it, with the upcoming ggml update it should be gone but it's currently unstable on macos. See #428.