Abstract:Indoor scene generation aims at creating shape-compatible, style-consistent furniture arrangements within a spatially reasonable layout. However, most existing approaches primarily focus on generating plausible furniture layouts without incorporating specific details related to individual furniture pieces. To address this limitation, we propose a two-stage model integrating shape priors into the indoor scene generation by encoding furniture as anchor latent representations. In the first stage, we employ discrete vector quantization to encode furniture pieces as anchor-latents. Based on the anchor-latents representation, the shape and location information of the furniture was characterized by a concatenation of location, size, orientation, class, and our anchor latent. In the second stage, we leverage a transformer model to predict indoor scenes autoregressively. Thanks to incorporating the proposed anchor-latents representations, our generative model produces shape-compatible and style-consistent furniture arrangements and synthesis furniture in diverse shapes. Furthermore, our method facilitates various human interaction applications, such as style-consistent scene completion, object mismatch correction, and controllable object-level editing. Experimental results on the 3D-Front dataset demonstrate that our approach can generate more consistent and compatible indoor scenes compared to existing methods, even without shape retrieval. Additionally, extensive ablation studies confirm the effectiveness of our design choices in the indoor scene generation model.

Learning Guidelines for Automatic Indoor Scene Design

Automatic Data-Driven Room Design Generation.

Learning 3 D Scene Synthesis from Annotated RGB-D Images

Web3D-based Automatic Furniture Layout System Using Recursive Case-Based Reasoning and Floor Field.

Web3d Learning Platform of Furniture Layout Based on Case-Based Reasoning and Distance Field.

Automatic Interior Layout with User-Specified Furniture.

Automatic Generation of Constrained Furniture Layouts

Automatic Indoor Areas Layout for Indoor Scenes Based on Example Database

Procedural Modeling Of Residential Zone Subject To Urban Planning Constraints

Active Arrangement of Small Objects in 3D Indoor Scenes

Automatic Furniture Layout Based on Functional Area Division.

Multi-Agent Reinforcement Learning of 3D Furniture Layout Simulation in Indoor Graphics Scenes

RoomDesigner: Encoding Anchor-latents for Style-consistent and Shape-compatible Indoor Scene Generation

Fast 3D Indoor Scene Synthesis with Discrete and Exact Layout Pattern Extraction

Style-compatible Object Recommendation for Multi-room Indoor Scene Synthesis

Learning to Place New Objects in a Scene

Fast 3D Indoor Scene Synthesis by Learning Spatial Relation Priors of Objects

Human-centric Indoor Scene Synthesis Using Stochastic Grammar

Knowledge Graph Construction with Structure and Parameter Learning for Indoor Scene Design

Fast 3D Indoor Scene Synthesis by LearningSpatial Relation Priors of Objects

Adaptive synthesis of indoor scenes via activity-associated object relation graphs.