joone / loz

Loz is a command-line tool that enables your preferred LLM to execute system commands and utilize Unix pipes, integrating AI capabilities with other Unix tools.

Using llama.cpp

joone opened this issue 7 months ago · comments

Joone Hur commented 7 months ago

We can use llama.cpp and codelamma

https://github.com/ggerganov/llama.cpp
https://about.fb.com/news/2023/08/code-llama-ai-for-coding/

Joone Hur commented 6 months ago

https://github.com/ollama/ollama
https://github.com/ollama/ollama-js
https://github.com/technovangelist/ollama-node

Joone Hur commented 6 months ago

Support for llama-cpp has been available using ollama since version 0.2.0