Allow user to specify custom endpoint for llama.cpp server
psugihara opened this issue · comments
Peter Sugihara commented
We got this request a couple times on /r/localllama
Definitely a power user feature, but could be relatively easy to implement.