Giters
1b5d
/
llm-api
Run any Large Language Model behind a unified API
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
152
Watchers:
3
Issues:
12
Forks:
24
1b5d/llm-api Issues
Illegal instruction (core dumped)
Updated
9 months ago
Comments count
3
Can llm-api be used to run a model with GPU rather than CPU
Closed
9 months ago
Comments count
7
Is this quantized 7b ggml model too old?
Closed
9 months ago
Comments count
9
GPTQ Models with safetensors? - 'Missing key(s) in state_dict'
Closed
9 months ago
Comments count
2
Example config file
Closed
9 months ago
Comments count
2
Question and stop sequence are included in LLM response
Closed
9 months ago
Comments count
5
No module named 'torch'
Closed
9 months ago
Comments count
4
How to train model with my data - can i use api?
Closed
10 months ago
Comments count
1
I need a tutorial or real example.
Closed
a year ago
Comments count
2
Consider refactor for model types
Updated
a year ago
any advice for getting this running with `gpt-x-alpaca` models?
Updated
a year ago
Comments count
20
Request: Lora support
Updated
a year ago
Comments count
1