dongzhuoyao / awesome-flow-matching

A summary of related works about flow matching, stochastic interpolants

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Awesome Flow Matching ( Stochastic Interpolant )

Star History Chart

Contributors

Papers

Flow Matching for Generative Modeling
Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel, Matt Le
ICLR 2023. [Paper]
10 Oct 2022

Building Normalizing Flows with Stochastic Interpolants
Michael S. Albergo and Eric Vanden-Eijnden
ICLR 2023. [Paper]
Sept 2022

Stochastic Interpolants: A Unifying Framework for Flows and Diffusions
Michael S. Albergo, Nicholas M. Boffi, Eric Vanden-Eijnden
Arxiv 2023. [Paper]
March 2023

Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
Xingchao Liu, Chengyue Gong, Qiang Liu
ICLR 2023. [Paper]
Sep 2022

Minimizing trajectory curvature of ode-based generative models
Sangyun Lee, Beomsu Kim, Jong Chul Ye
ICML 2023. [Paper]
Jan 2023

Multisample Flow Matching: Straightening Flows with Minibatch Couplings
Aram-Alexandre Pooladian, Heli Ben-Hamu, Carles Domingo-Enrich, Brandon Amos, Yaron Lipman, Ricky T. Q. Chen
Arxiv Apr 2023. [Paper]

On Kinetic Optimal Probability Paths for Generative Models
Neta Shaul, Ricky T. Q. Chen, Maximilian Nickel, Matt Le, Yaron Lipman
Arxiv June 2023. [Paper]

Action Matching: Learning Stochastic Dynamics from Samples
Kirill Neklyudov, Rob Brekelmans, Daniel Severo, Alireza Makhzani
ICML 2023. [Paper]
Oct 2022

Error Bounds for Flow Matching Methods
Joe Benton, George Deligiannidis, Arnaud Doucet
Arxiv 2023. [Paper]

Functional Flow Matching
Gavin Kerrigan, Giosue Migliorini, Padhraic Smyth
Arxiv May 2023. [Paper]

Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling
Grigory Bartosh, Dmitry Vetrov, Christian A. Naesseth
Arxiv April 2024. [Paper]

Align Your Steps: Optimizing Sampling Schedules in Diffusion Models
Amirmojtaba Sabour, Sanja Fidler, Karsten Kreis
Arxiv April 2024. [Paper]

Multidimensional Interpolants\ Dohoon Lee, Kyogu Lee
Arxiv April 2024. [Paper]

Theory

Flow matching achieves minimax optimal convergence
Kenji Fukumizu, Taiji Suzuki, Noboru Isobe, Kazusato Oko, Masanori Koyama
Arxiv 2405. [Paper]

Improving the Training of Rectified Flows
Sangyun Lee, Zinan Lin, Giulia Fanti
Arxiv 2405. [Paper]

Denoising Diffusion Bridge Models
Linqi Zhou, Aaron Lou, Samar Khanna, Stefano Ermon
ICLR 24. [Paper]

Extended Flow Matching: a Method of Conditional Generation with Generalized Continuity Equation
Noboru Isobe, Masanori Koyama, Kohei Hayashi, Kenji Fukumizu
Arxiv 2402. [Paper]

Bespoke Solvers for Generative Flow Models
Neta Shaul, Juan Perez, Ricky T. Q. Chen, Ali Thabet, Albert Pumarola, Yaron Lipman
Arxiv 2023. [Paper]

Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs
Kaiwen Zheng, Cheng Lu, Jianfei Chen, Jun Zhu
ICML 2023. [Paper]
May 2023

Minimizing Trajectory Curvature of ODE-based Generative Models
Sangyun Lee, Beomsu Kim, Jong Chul Ye
arXiv 2023. [Paper]
Jan 2023

Self-Consistent Velocity Matching of Probability Flows
Lingxiao Li, Samuel Hurault, Justin Solomon
arXiv 2023. [Paper]
22 Feb 2023

Stochastic Interpolants: A Unifying Framework for Flows and Diffusions
Michael S. Albergo, Nicholas M. Boffi, Eric Vanden-Eijnden
arXiv 2023. [Paper]
15 Mar 2023

Interpretable ODE-style Generative Diffusion Model via Force Field Construction
Weiyang Jin, Yongpei Zhu, Yuxi Peng
arXiv 2023. [Paper]
15 Mar 2023

Generative Diffusions in Augmented Spaces: A Complete Recipe
Kushagra Pandey, Stephan Mandt
arXiv 2023. [Paper]
3 Mar 2023

A theory of continuous generative flow networks
Salem Lahlou, Tristan Deleu, Pablo Lemos, Dinghuai Zhang, Alexandra Volokhova, Alex Hernández-García, Léna Néhale Ezzine, Yoshua Bengio, Nikolay Malkin
arXiv 2023. [Paper,Code]
30 Jan 2023

Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs
Kaiwen Zheng, Cheng Lu, Jianfei Chen, Jun Zhu
ICML 2023. [Paper]

Diffusion Schrödinger Bridge Matching
Yuyang Shi, Valentin De Bortoli, Andrew Campbell, Arnaud Doucet
Arxiv March 2023. [Paper]

Aligned Diffusion Schrödinger Bridges
Vignesh Ram Somnath, Matteo Pariset, Ya-Ping Hsieh, Maria Rodriguez Martinez, Andreas Krause, Charlotte Bunne
UAI 2023. [Paper]

Optimal Flow Matching: Learning Straight Trajectories in Just One Step
Nikita Kornilov, Alexander Gasnikov, Alexander Korotin
Arxiv 2403. [Paper]

Simplified Diffusion Schrödinger Bridge
Zhicong Tang, Tiankai Hang, Shuyang Gu, Dong Chen, Baining Guo
Arxiv 2403. [Paper]

Switched Flow Matching: Eliminating Singularities via Switching ODEs
Qunxi Zhu, Wei Lin
ICML 2024. [Paper]

Discrete Data

Variational Flow Matching for Graph Generation Floor Eijkelboom, Grigory Bartosh, Christian Andersson Naesseth, Max Welling, Jan-Willem van de Meent
Arxiv 2024/06. [Paper]

Accelerating

Bespoke Non-Stationary Solvers for Fast Sampling of Diffusion and Flow Models Neta Shaul, Uriel Singer, Ricky T. Q. Chen, Matthew Le, Ali Thabet, Albert Pumarola, Yaron Lipman
Arxiv 2024/03. [Paper]

Applications

SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flow Chaoyang Wang, Xiangtai Li, Lu Qi, Henghui Ding, Yunhai Tong, Ming-Hsuan Yang
Arxiv 2024/05. [Paper]

Preference Alignment with Flow Matching Minu Kim, Yongsik Lee, Sehyeok Kang, Jihwan Oh, Song Chong, Seyoung Yun
Arxiv 2024/05. [Paper]

Metric Flow Matching for Smooth Interpolations on the Data Manifold Kacper Kapusniak, Peter Potaptchik, Teodora Reu, Leo Zhang, Alexander Tong, Michael Bronstein, Avishek Joey Bose, Francesco Di Giovanni
Arxiv 2024/05. [Paper]

Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers
*Peng Gao, Le Zhuo, Ziyi Lin, Chris Liu, Junsong Chen, Ruoyi Du, Enze Xie, Xu Luo, Longtian Qiu, Yuhang Zhang, Chen Lin, Rongjie Huang, Shijie Geng, Renrui Zhang, Junlin Xi, Wenqi Shao, Zhengkai Jiang, Tianshuo Yang, Weicai Ye, He Tong, Jingwen He, Yu Qiao, Hongsheng Li *
Arxiv 2024/05. [Paper]

Mixed Continuous and Categorical Flow Matching for 3D De Novo Molecule Generation
Ian Dunn, David Ryan Koes
Arxiv 2024/04. [Paper]

Dirichlet Flow Matching with Applications to DNA Sequence Design
Hannes Stark, Bowen Jing, Chenyu Wang, Gabriele Corso, Bonnie Berger, Regina Barzilay, Tommi Jaakkola
Arxiv 2024/02. [Paper]

D-Flow: Differentiating through Flows for Controlled Generation
Heli Ben-Hamu, Omri Puny, Itai Gat, Brian Karrer, Uriel Singer, Yaron Lipman
ICML 2024. [Paper]

Dynamic Conditional Optimal Transport through Simulation-Free Flows \ Gavin Kerrigan, Giosue Migliorini, Padhraic Smyth
Arxiv 2404. [Paper]

LayoutFlow: Flow Matching for Layout Generation
Julian Jorge Andrade Guerreiro, Naoto Inoue, Kento Masui, Mayu Otani, Hideki Nakayama
Arxiv 2403. [Paper]

Generalized Consistency Trajectory Models for Image Manipulation\ Beomsu Kim, Jaemin Kim, Jeongsol Kim, Jong Chul Ye
Arxiv 2403. [Paper]

Probabilistic Forecasting with Stochastic Interpolants and F¨ollmer Processes \ Yifan Chen, Mark Goldstein, Mengjian Hua, Michael S. Albergo, Nicholas M. Boffi, Eric Vanden-Eijnden
Arxiv 2403. [Paper]

DepthFM: Fast Monocular Depth Estimation with Flow Matching
Ming Gui, Johannes S. Fischer*, Ulrich Prestel, Pingchuan Ma, Dmytro Kotovenko, Olga Grebenkova, Stefan Andreas Baumann, Vincent Tao Hu, Björn Ommer*
Arxiv 2403. [Paper]

ZigMa: Zigzag Mamba Diffusion Model
Vincent Tao Hu, Stefan Andreas Baumann, Ming Gui, Olga Grebenkova, Pingchuan Ma, Johannes Fischer, Bjorn Ommer
Arxiv 2403. [Paper]

AdaFlow: Imitation Learning with Variance-Adaptive Flow-Based Policies
Xixi Hu, Bo Liu, Xingchao Liu, Qiang Liu
Arxiv 2402. [Paper]

Precise Knowledge Transfer via Flow Matching
Shitong Shao, Zhiqiang Shen, Linrui Gong, Huanran Chen, Xu Dai
Arxiv 2402. [Paper]

Boosting Latent Diffusion with Flow Matching
Johannes S. Fischer, Ming Gui*, Pingchuan Ma*, Nick Stracke, Stefan A. Baumann, Björn Ommer*
Arxiv 2312. [Paper]

Guided Flows for Generative Modeling and Decision Making
Qinqing Zheng, Matt Le, Neta Shaul, Yaron Lipman, Aditya Grover, Ricky T. Q. Chen
Arxiv 2311. [Paper]

Scaling Rectified Flow Transformers for High-Resolution Image Synthesis
*Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, Dustin Podell, Tim Dockhorn, Zion English, Kyle Lacey, Alex Goodwin, Yannik Marek, Robin Rombach *
Arxiv 2403. [Paper]

Flow Matching for Conditional Text Generation in a Few Sampling Steps
Vincent Tao Hu, Di Wu, Yuki M. Asano, Pascal Mettes, Basura Fernando, Björn Ommer, Cees G.M. Snoek
EACL 2024. [Paper]

SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers
Nanye Ma, Mark Goldstein, Michael S. Albergo, Nicholas M. Boffi, Eric Vanden-Eijnden, Saining Xie
Arxiv 2401. [Paper]

AlphaFold Meets Flow Matching for Generating Protein Ensembles
Bowen Jing, Bonnie Berger, Tommi Jaakkola
Arxiv 2402. [Paper]

Bellman Optimal Step-size Straightening of Flow-Matching Models
Bao Nguyen, Binh Nguyen, Viet Anh Nguyen
Arxiv 2312. [Paper]

Latent Space Editing in Transformer-based Flow Matching
Vincent Tao Hu, David W Zhang, Pascal Mettes, Meng Tang, Deli Zhao, Cees G.M. Snoek
AAAI 2024. [Paper]

Motion Flow Matching for Human Motion Synthesis and Editing
Vincent Tao Hu, Wenzhe Yin, Pingchuan Ma, Yunlu Chen, Basura Fernando, Yuki M Asano, Efstratios Gavves, Pascal Mettes, Bjorn Ommer, Cees G. M. Snoek
Arxiv 2023. [Paper]

Guided Diffusion from Self-Supervised Diffusion Features
Vincent Tao Hu, Yunlu Chen, Mathilde Caron, Yuki M. Asano, Cees G. M. Snoek, Bjorn Ommer
Arxiv 2023. [Paper]

Mosaic-SDF for 3D Generative Models
Lior Yariv, Omri Puny, Natalia Neverova, Oran Gafni, Yaron Lipman
Arxiv 2312. [Paper]

Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale
Matthew Le, Apoorv Vyas, Bowen Shi, Brian Karrer, Leda Sari, Rashel Moritz, Mary Williamson, Vimal Manohar, Yossi Adi, Jay Mahadeokar, Wei-Ning Hsu
Arxiv June 2023. [Paper]

Learn the Force We Can: Multi-Object Video Generation from Pixel-Level Interactions
Aram Davtyan, Paolo Favaro
Arxiv June 2023. [Paper]

Latent Space Editing in Transformer-based Flow Matching
Tao Hu, David W Zhang, Pascal Mettes, Meng Tang, Deli Zhao, and Cees G.M. Snoek
ICML 2023 Workshop, Oct 2023. [Paper]

Unpaired Image-to-Image Translation via Neural Schrödinger Bridge
Beomsu Kim, Gihyun Kwon, Kwanyoung Kim, Jong Chul Ye
Arxiv May 2023. [Paper]

Flow Matching for Scalable Simulation-Based Inference
Maximilian Dax, Jonas Wildberger, Simon Buchholz, Stephen R. Green, Jakob H. Macke, Bernhard Schölkopf
Arxiv May 2023. [Paper]

Equivariant flow matching
Leon Klein, Andreas Krämer, Frank Noé
Arxiv June 2023. [Paper]

Fast Point Cloud Generation with Straight Flows
Lemeng Wu, Dilin Wang, Chengyue Gong, Xingchao Liu, Yunyang Xiong, Rakesh Ranjan, Raghuraman Krishnamoorthi, Vikas Chandra, Qiang Liu
arXiv 2022. [Paper]
4 Dec 2022

Randomized Conditional Flow Matching for Video Prediction
Aram Davtyan, Sepehr Sameni, Paolo Favaro
arXiv 2022. [Paper]
16 Nov 2022

Riemannian Flow Matching on General Geometries
Ricky T. Q. Chen, Yaron Lipman
ICLR 2024. [Paper]
27 Feb 2023

About

A summary of related works about flow matching, stochastic interpolants