Thoughts on streaming
fire17 opened this issue · comments
Tami commented
Hi there :)
In the future I see many pipelines, any2video, audio+text+image2video
But am wondering about the ability to instead of prerendeing everything, to optimize for realtime streaming, continueing frames, and being able to alter the prompt as the video is generating. Something like realtime SD with last frame being a reference.
Then to achieve SOTA quality, stream to an upscaler, and character/obj consistency layers.
Zheng Zangwei (Alex Zheng) commented
Thanks for your thoughts. We are working hard on what you have thought. Hope everything goes well and the new model can meet you soon.