Lightning-Universe / stable-diffusion-deploy

Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.

Home Page:https://lightning.ai/muse

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Separate the load balancer as a reusable Component

aniketmaurya opened this issue · comments

The load balancer can be reused for similar instances where we need multiple works or automatic batching. We can convert this into a separate component and add it to Gallery.

cc: @ethanwharris