Abstract:Given a real source scene and a virtual target scene, the real-scene-constrained virtual scene layout synthesis problem is defined as how to re-synthesize the layout of the virtual furniture in the virtual scene to form a new virtual scene such that the new scene not only looks similar to the input real and virtual scenes but also is interactive. The goal of this problem is to maximize interactivity and fidelity which are contradictory. To solve this problem, we propose a real-scene-constrained virtual scene layout synthesis method to synthesize the layout of the virtual furniture in the new virtual scene. We split the scene layout synthesis process into 3 interrelated steps: scene matching, matched furniture layout generating, and unmatched furniture layout generating. For scene matching, we propose a deep scene matching network to predict the matching relationship between real and virtual furniture. For matched furniture layout generating, we propose a layout parameters optimization algorithm to predict suitable layouts of the matched virtual furniture. For unmatched furniture layout generating, we propose a deep scene generating network to predict suitable layouts of unmatched virtual furniture. We evaluate the quality of our method to synthesize scenes of different kinds and sizes. The results show that, compared with the heuristic rules-based method, our method has better matching accuracy and location accuracy. We also design a user study to evaluate the interactivity and fidelity. Compared to the manual method and the heuristic rules-based method, our method has a significant improvement in interactivity and fidelity.

Wall Grid Structure for Interior Scene Synthesis.

Web3D-based Automatic Furniture Layout System Using Recursive Case-Based Reasoning and Floor Field.

Learning 3 D Scene Synthesis from Annotated RGB-D Images

Structure Guided Interior Scene Synthesis Via Graph Matching.

A Survey of 3D Indoor Scene Synthesis

Fast 3D Indoor Scene Synthesis with Discrete and Exact Layout Pattern Extraction

Automatic Generation of Commercial Scenes

RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture

Interior Layout Generation Based on Scene Graph and Graph Generation Model

Reshuffle-based Interior Scene Synthesis

SceneCraft: Layout-Guided 3D Scene Generation

SceneExpander: Real-Time Scene Synthesis for Interactive Floor Plan Editing

GLTScene: Global‐to‐Local Transformers for Indoor Scene Synthesis with General Room Boundaries

RoomDesigner: Encoding Anchor-latents for Style-consistent and Shape-compatible Indoor Scene Generation

Structural Plan of Indoor Scenes with Personalized Preferences

Style-Consistent 3D Indoor Scene Synthesis with Decoupled Objects

CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embedding

ControlRoom3D: Room Generation using Semantic Proxy Rooms

Real-scene-constrained virtual scene layout synthesis for mixed reality

Human-centric Indoor Scene Synthesis Using Stochastic Grammar

Fast 3D Indoor Scene Synthesis by LearningSpatial Relation Priors of Objects