Lightning-Universe / stable-diffusion-deploy

Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.

Home Page:https://lightning.ai/muse

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

UI always shows same time in progress bar (~51 seconds) which is not true

aniketmaurya opened this issue · comments

Send the current avg response time from server to UI

class RootFlow(LightningFlow):
    def __init__(self):
        self.curr_response_time = VALUE

we can use LigthningVariable to update the UI progress bar time.

cc: @pritamsoni-hsr