Giters

ravenscroftj / turbopilot

Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

arm64 image

GeekWorkCode opened this issue · comments

commented

I have an arm64 server. Can I support arm64?

commented

Hi there,

I need to add arm64 builds to the CI pipeline. In the mean time, you can try cloning the repo and subproject and running docker build from your server - it should pull in the arm dependencies. I will get something set up for automatic arm build soon

commented

Hi again @GeekWorkCode

I have now added ARM64 builds to the CI pipeline so you should just be able to run it straight away now:

docker run --rm -it \
  -v ./models:/models \
  -e THREADS=6 \
  -e MODEL="/models/codegen-2B-multi-ggml-4bit-quant.bin" \
  -p 18080:18080 \
  ghcr.io/ravenscroftj/turbopilot:latest

Please note the docker image URI name has changed to ghcr.io/ravenscroftj/turbopilot:latest