XeonG / smooth-infinite-zoom

User friendly infinite zoom video generation tool in Colab (based on Stable Diffusion)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Smooth Infinite Zoom

A user friendly colab notebook to generate infinite loop videos in minutes (works on free colab plan)

👇 Click here to craft your own video
Open In Colab

Examples:

Dream of a Distant Galaxy:

Infinite.Zoom.-.Dream.of.a.distant.galaxy.online-video-cutter.com.mp4

Downtown Alley:
Infinite.Zoom.-.Downtown.alley.SHORT.mp4

Ancient Mechanism:
Infinite.Zoom.-.Ancient.mechanism.mp4

Colorful Fractals:
Infinite.Zoom.-.Colorful.fractals.SHORT.mp4

Cave of Skulls:
Infinite.Zoom.-.Cave.of.skulls.SHORT.mp4

Videos above were generated using the default settings in the notebook. Other than random seed only 1st part of the prompt was changed according to the video title (with slight alternations in some cases) e.g. prompt = "glowing colorful fractals, concept art, HQ, 4k".

Credits

  • Original idea and 1st version of the notebook was created by hardmaru
  • Thereafter BalintKomjati made the following improvements:
    • Adopted to run on Google Colab
    • Introduced "interpolation" between outpainted images to create smoother videos. This allows to use wider outpainting masks which tend to generate larger coherent structures, without unpleasant jumps between frames.
    • Put the whole product into a intuitive, user friendly notebook (at least that was the intention :) )

Backlog of potential improvements (contributions are welcome):

  • AUTOMATIC1111 integration
  • Add the possibility for the output to "drift" between prompts (now uses the same prompt for all images with different seed)
  • Fix the issue that any resolution higer than 512 will drastically decrease the network's imagination resulting the generated video rather boring. (e.g. upscale after each inpainting step?)
  • Make movement in the video more realistic without "fisheye" distorsions
  • Possibility to change movement of the camera during video (e.g. turns in any direction)
  • Generate video in non-cubic resolution (now only cubic is possible)

About

User friendly infinite zoom video generation tool in Colab (based on Stable Diffusion)

License:MIT License


Languages

Language:Jupyter Notebook 100.0%