Potassium Llama V2 7B chat
This is a Potassium HTTP server, created with banana init CLI. Based on the model: meta-llama/Llama-2-7b-chat-hf.
Testing
Start a local dev server with banana dev
Run test script python test.py
Deployment
- Create empty repo on Github
- Push this repo to github
git remote add origin https://github.com/{username}/{repo-name}.git
- Log into Banana
- Select this repo to build and deploy!