Setup Ollama stack on macOS.
- A Metal capable Mac device.
- Mods: AI for the command line, built for pipelines.
- Docker: The fastest way to containerize applications.
graph LR;
subgraph Host
subgraph CLI
B(Mods)
G(Collector)
end
subgraph Server
C(Ollama)
D[Metal]
end
end
subgraph Container
E(LiteLLM Proxy)
F(Ollama Web UI)
H(Prometheus)
I(Grafana)
end
A(User) --> |Terminal|B;
A --> |Browser|F;
B --> |OpenAI API|E;
E --> |REST API|C;
F --> |REST API|C;
C-. Link .-> D;
H --> |Client API|G;
I --> |Data Source|H;
$ git clone https://github.com/yeahdongcn/OllamaStack.git
$ cd OllamaStack
$ ./start.sh
$ ./stop.sh
![Screenshot 2024-01-31 at 11 45 31](https://private-user-images.githubusercontent.com/2831050/301033062-3370513b-8920-4ee1-bc7c-0f2e4c4e8c40.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjAzNTI3MTIsIm5iZiI6MTcyMDM1MjQxMiwicGF0aCI6Ii8yODMxMDUwLzMwMTAzMzA2Mi0zMzcwNTEzYi04OTIwLTRlZTEtYmM3Yy0wZjJlNGM0ZThjNDAucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDcwNyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA3MDdUMTE0MDEyWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MmRhNmQ5Zjg4OWUzNTYyMjg2YTc4NTc3YTc3NTJmNjk3NjFhZDJjOTcwMWYzMWY1OTFhMWQzYmE1ZWM1YTZmMSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.zO0LLlDQin-_8JH6rfzuF7w9gUc2MJRoYv7A8KohYWM)