Layout Generation refers to the multi-modal problem of generating layouts of a flyer, magazine, a UI interface or even a natural image.
This is a niche area, which is increasingly receiving attention from the community. This awesome-listing is an attempt to bring together works in this space. This list is not complete and looking for your PRs to improve it. Thanks!
- Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation [Paper]
- Diffusion-based Document Layout Generation [Paper]
- LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer [Paper]
- UniLayout: Taming Unified Sequence-to-Sequence Transformers for Graphic Layout Generation [Paper]
- LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models (ICLR 2024) [Paper] [Code]
- Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints (ICLR 2024) [Paper]
- LayoutGPT: Compositional Visual Planning and Generation with Large Language Models (NeurIPS 2023) [Paper] [Code]
- LayoutPrompter: Awaken the Design Ability of Large Language Models (NeurIPS 2023) [Paper] [Code]
- A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptions (ICCV 2023) [Paper] [Code]
- LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models (ICCV 2023) [Paper] [Code]
- DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer (ICCV 2023) [Project page] [Paper] [Code]
- Unifying Layout Generation with a Decoupled Diffusion Model (CVPR 2023) [Paper]
- LayoutDM: Discrete Diffusion Model for Controllable Layout Generation (CVPR 2023) [Paper] [Code]
- LayoutDM: Transformer-based Diffusion Model for Layout Generation (CVPR 2023) [Paper]
- PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layout (CVPR 2023) [Paper] [Code]
- Towards Flexible Multi-modal Document Models (CVPR 2023) [Paper] [Code]
- Machine Learning Model to Evaluate the Appropriateness of Layout for Automatic Generation of Graphic Design Works (IMCOM 2023) [Paper]
- BLT: Bidirectional Layout Transformer for Controllable Layout Generation (ECCV 2022) [Paper] [Code]
- Coarse-to-Fine Generative Modeling for Graphic Layouts (AAAI 2022) [Paper]
- Geometry Aligned Variational Transformer for Image-conditioned Layout Generation (MM 2022) [Paper]
- Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs (IJCAI 2022) [Paper]
- Variational Transformer Networks for Layout Generation (CVPR 2021) [Paper]
- LayoutTransformer: Scene Layout Generation with Conceptual and Spatial Diversity (CVPR 2021) [Paper] [Code]
- Constrained Graphic Layout Generation via Latent Optimization (MM 2021) [Paper] [Code]
- LayoutTransformer: Layout Generation and Completion with Self-attention (ICCV 2021) [Paper] [Code]
- CanvasVAE: Learning to Generate Vector Graphic Documents (ICCV 2021) [Paper] [Code]
- RUITE: Refining UI Layout Aesthetics Using Transformer Encoder (IUI 2021) [Paper] [Code]
- Neural Design Network: Graphic Layout Generation with Constraints (ECCV 2020) [Paper]
- Attribute-conditioned Layout GAN for Automatic Graphic Design (T-VCG 2020) [Paper]
- READ: Recursive Autoencoders for Document Layout Generation (CVPRW 2020) [Paper]
- LayoutGAN: Synthesizing Graphic Layouts with Vector-Wireframe Adversarial Networks (ICLR 2019, T-PAMI 2021) [ICLR paper] [T-PAMI Paper]
- LayoutVAE: Stochastic Scene Layout Generation From a Label Set (ICCV 2019) [Paper]
- Designscape: Design with interactive layout suggestions (CHI 2015) [Paper]
- Learning Layouts for Single-Page Graphic Designs (TVCG 2014) [Paper]