awsdataarchitect / ecs-ollama-deepseek

Deploying DeepSeek R1 on ECS Fargate with Open WebUI: A Scalable Ollama based AI ChatBot

Deploying DeepSeek R1 on ECS Fargate with Open WebUI: A Scalable Ollama based AI ChatBot

A complete CDK Automation with DeepSeek R1 Chatbot confined locally inside AWS ECS Fargate container running Ollama that doesn't transmit your data to China!

Architecture Diagram

For more details on how to deploy the infrastructure and solution details, please refer to the Blog Post:

• Deploying DeepSeek R1 on ECS Fargate with Open WebUI: A Scalable Ollama based AI ChatBot.

Pro Tip 💡

Add a new LLM to your Ollama container by simply running the following curl command:

curl -X POST http://<OLLAMA_LB_DNS>/api/pull -d '{"name": "your-model-name"}'

Replace "your-model-name-here" with any supported LLM (e.g., deepseek-r1:1.5b, mistral:7b)

Useful commands

• npm run build compile typescript to js
• npm run watch watch for changes and compile
• npm run test perform the jest unit tests
• cdk deploy deploy this stack to your default AWS account/region
• cdk diff compare deployed stack with current state
• cdk synth emits the synthesized CloudFormation template