Are there any memory optimization flags I can add to the gradio app.py?
brentjohnston opened this issue · comments
brentjohnston commented
I'm just testing out the official source's gradio app.py here and comparing the results versus other places.
I have a 4090, but it takes over 5 minutes to make one image in the gradio. Are there any flags I can before running python app.py
or any pip install stuff I can do to help speed this up?
Furkan Gözükara commented
sadly there aren't
for who cant make, i spent days to make this amazing installer and app
for 1024x1024 with our app at full quality , RTX 3090 TI takes total 19 seconds , Prior Inference Steps = 30 and Decoder Inference Steps = 20