How to set model path?
linonetwo opened this issue · comments
Like modelPath: path.join(__dirname, "models", "codellama-13b.Q3_K_M.gguf")
in https://github.com/withcatai/node-llama-cpp?tab=readme-ov-file#usage
And, is this a client that use HTTP to communicate with ollama server, or use node-addon to do so? I hope I can use it without set up a HTTP server.
This is just a HTTP client. Not node addon based like https://github.com/withcatai/node-llama-cpp