What is FluidFrames.RIFE?
FluidFrames.RIFE is a Windows app powered by RIFE-HD AI to fluidify videos and to create slowmotion videos.
Other AI projects.🤓
- https://github.com/Djdefrag/QualityScaler / QualityScaler - image/video AI upscaler app
- https://github.com/Djdefrag/RealScaler / RealScaler - image/video AI upscaler app (Real-ESRGAN)
Credits.
- RIFE - https://github.com/megvii-research/ECCV2022-RIFE
- PraticalRIFE - https://github.com/hzwer/Practical-RIFE
How is made. 🛠
FluidFrames.RIFE is completely written in Python, from backend to frontend. External packages are:
- AI -> torch / torch-directml
- GUI -> customtkinter
- Image/video -> openCV / moviepy
- Packaging -> nuitka
Requirements. 🤓
- Windows 11 / Windows 10
- RAM >= 8Gb
- Any Directx12 compatible GPU with >= 2GB VRAM
Features.
- Elegant and easy to use GUI
- Video frames interpolation x2 / x4 / x8
- 30fps => x2 => 60fps
- 30fps => x4 => 120fps
- 30fps => x8 => 240fps
- Video slowmotion x2 /x4
- 30fps => x2_slowmotion => 30fps - 2 times slower
- 30fps => x4_slowmotion => 30fps - 4 times slower
- 30fps => x8_slowmotion => 30fps - 8 times slower
- Resize video before interpolation
- Multiple gpu backend
- Compatible video - mp4, wemb, gif, mkv, flv, avi, mov, qt
Next steps. 🤫
- 1.X versions
- Switch to Pytorch-directml to support all Directx12 compatible gpu (AMD, Intel, Nvidia)
- New GUI with Windows 11 style
- Include audio for processed video
- Optimizing video frame resize and extraction speed
- Multi GPU support (for pc with double GPU, integrated + dedicated)
- Python 3.10 (expecting ~10% more performance)
- Slowmotion function
- 2.X versions (now under development)
- New, completely redesigned graphical interface based on @customtkinter
- Fluidify multiple videos at once
- Save AI generated frames as files
- Support RIFE AI model updates
- Support for RIFE_Lite AI model (a faster and lighter version of RIFE)
- Python 3.11 (expecting ~30% more performance)
- Torch/torch-directml 2.0 (expecting ~20% more performance)
Some Examples.
Videos
- Original / x4 / x2-slomotion
giphy_RIFEx4_100.mp4
giphy_RIFEx2_slowmo_100.mp4
- Original / x4 / x4-slomotion
deadpool.mp4
deadpool_RIFEx4_100.mp4
deadpool_RIFEx4_slowmo_100.mp4
- Original / x2
original.mp4
gg.ss.RIFEHDv3.mp4
- Original / x2
209639439-94c8774d-354e-4d56-9123-e1aa4af95e08_RIFE_HDv3.mp4
- Original / x2 / x2-slomotion