Varnish is a library to add some flair to sequence of frames generated with AI video models, to turn them into nice MP4 video files, with precise control over the compression levels, framerate, film grain noise.
It can handle frame upscaling and frame interpolation.
VideoModelStudio is 100% open-source project, this is a project I really develop just for myself initially, for my Hugging Face Inference Endpoints.
I'm more or less the only user so I maintain it on my personal time, so if you like it let me know 🫶
This project uses various open-source librairies and AI models to work.
All credits is due to them! Varnish is only a modest library mixing and mashing things together.
In particular Varnish uses those AI projects:
- MMAudio: https://github.com/hkchengrex/MMAudio
- Real-ESRGAN: https://github.com/xinntao/Real-ESRGAN
- RIFE: https://github.com/hzwer/ECCV2022-RIFE
Please see the requirements.txt
file for details.
# ..not yet!
# pip install varnish
git clone https://github.com/jbilcke-hf/varnish
cd varnish
pip install -e .