kerrickchan / crud-llama

CodeLLaMA for CRUD Entity. v0.0.2 already stopped further development. Looks for Official Devika instead

CodeLLaMA in Apple Silicon

there are 2 options in this project

1. llama-cpp-python with Metal support
2. ctransformers with Metal support

LLaMA-CPP-Python Option

this option provided to checkout the Model meta for config the CTransformers option

make init
make setup-server
make server

CTransformers Option

this option is used to run the model

make init
make setup
make start