Abstract:In the domain of image layout representation learning, the critical process of translating image layouts into succinct vector forms is increasingly significant across diverse applications, such as image retrieval, manipulation, and generation. Most approaches in this area heavily rely on costly labeled datasets and notably lack in adapting their modeling and learning methods to the specific nuances of photographic image layouts. This shortfall makes the learning process for photographic image layouts suboptimal. In our research, we directly address these challenges. We innovate by defining basic layout primitives that encapsulate various levels of layout information and by mapping these, along with their interconnections, onto a heterogeneous graph structure. This graph is meticulously engineered to capture the intricate layout information within the pixel domain explicitly. Advancing further, we introduce novel pretext tasks coupled with customized loss functions, strategically designed for effective self-supervised learning of these layout graphs. Building on this foundation, we develop an autoencoder-based network architecture skilled in compressing these heterogeneous layout graphs into precise, dimensionally-reduced layout representations. Additionally, we introduce the LODB dataset, which features a broader range of layout categories and richer semantics, serving as a comprehensive benchmark for evaluating the effectiveness of layout representation learning methods. Our extensive experimentation on this dataset demonstrates the superior performance of our approach in the realm of photographic image layout representation learning.

Deep Layout of Custom-size Furniture through Multiple-domain Learning

Web3d Learning Platform of Furniture Layout Based on Case-Based Reasoning and Distance Field.

Deep Reinforcement Learning for Producing Furniture Layout in Indoor Scenes

End-to-end Generative Floor-plan and Layout with Attributes and Relation Graph

Web3D-based Automatic Furniture Layout System Using Recursive Case-Based Reasoning and Floor Field.

Multi-Agent Reinforcement Learning of 3D Furniture Layout Simulation in Indoor Graphics Scenes

Learning 3 D Scene Synthesis from Annotated RGB-D Images

Automatic Interior Layout with User-Specified Furniture.

Hierarchical Reinforcement Learning for Furniture Layout in Virtual Indoor Scenes

Furnishing Your Room by What You See: An End-to-End Furniture Set Retrieval Framework with Rich Annotated Benchmark Dataset

RoomDesigner: Encoding Anchor-latents for Style-consistent and Shape-compatible Indoor Scene Generation

Structural Deep Metric Learning for Room Layout Estimation

Structural Plan of Indoor Scenes with Personalized Preferences

Automated building layout generation using deep learning and graph algorithms

Adversarial Model for Rotated Indoor Scenes Planning

CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embedding

GLTScene: Global‐to‐Local Transformers for Indoor Scene Synthesis with General Room Boundaries

CVAE-LAYOUT: Automatic Furniture Layout with Constraints

Automatic Furniture Layout Based on Functional Area Division.

Layout Generation for Various Scenarios in Mobile Shopping Applications.

Self-supervised Photographic Image Layout Representation Learning