uber / fiber

Distributed Computing for AI Made Simple

Home Page:https://uber.github.io/fiber/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Docker Swarm support

danilopeixoto opened this issue · comments

I want to use Fiber to execute a job queue on a Docker Swarm cluster. Fiber already has a Docker backend that spawns processes as containers. What about spawning processes as Docker Swarm services?

Swarm would be a new backend, right?

Hi @danilopeixoto, docker swarm is currently not supported, but it could be added as a new backend. I'm less familiar with Docker swarm, not sure if it has similar APIs like Kubernetes. If it does, it should be easy to create a new docker swarm backend and implement the functions here https://github.com/uber/fiber/blob/master/fiber/core.py#L79 with docker swarm API.

Just out of interest, what is your main use case? Trying to understand different use cases so that future priorities can be prepared.