This is the official implementation for MOWA (arXiv 2024).
Kang Liao, Zongsheng Yue, Zhonghua Wu, Chen Change Loy
S-Lab, Nanyang Technological University
MOWA is a practical multiple-in-one image warping framework, particularly in computational photography, where six distinct tasks are considered. Compared to previous works tailored to specific tasks, our method can solve various warping tasks from different camera models or manipulation spaces in a single framework. It also demonstrates an ability to generalize to novel scenarios, as evidenced in both cross-domain and zero-shot evaluations.
- The first practical multiple-in-one image warping framework especially in the field of computational photography.
- We propose to mitigate the difficulty of multi-task learning by decoupling the motion estimation in both the region level and pixel level.
- A prompt learning module, guided by a lightweight point-based classifier, is designed to facilitate task-aware image warpings.
Check out more visual results and interactions here.
- MOWA has been included in AI Art Weekly #80.
- 2023.04.16: The paper of the arXiv version is online.
- Release the code and pre-trained model.
- Release a demo for users to try MOWA online.
- Release an interactive interface to drag the control points and perform customized warpings.
Coming soon.