Abstract:Learning-based methods have become increasingly popular in 3D indoor scene synthesis (ISS), showing superior performance over traditional optimization-based approaches. These learning-based methods typically model distributions on simple yet explicit scene representations using generative models. However, due to the oversimplified explicit representations that overlook detailed information and the lack of guidance from multimodal relationships within the scene, most learning-based methods struggle to generate indoor scenes with realistic object arrangements and styles. In this paper, we introduce a new method, Scene Implicit Neural Field (S-INF), for indoor scene synthesis, aiming to learn meaningful representations of multimodal relationships, to enhance the realism of indoor scene synthesis. S-INF assumes that the scene layout is often related to the object-detailed information. It disentangles the multimodal relationships into scene layout relationships and detailed object relationships, fusing them later through implicit neural fields (INFs). By learning specialized scene layout relationships and projecting them into S-INF, we achieve a realistic generation of scene layout. Additionally, S-INF captures dense and detailed object relationships through differentiable rendering, ensuring stylistic consistency across objects. Through extensive experiments on the benchmark 3D-FRONT dataset, we demonstrate that our method consistently achieves state-of-the-art performance under different types of ISS.

Fast 3D Indoor Scene Synthesis by LearningSpatial Relation Priors of Objects

Fast 3D Indoor Scene Synthesis by Learning Spatial Relation Priors of Objects

Learning 3 D Scene Synthesis from Annotated RGB-D Images

Fast 3D Indoor Scene Synthesis with Discrete and Exact Layout Pattern Extraction

DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-Aware Scene Synthesis

Action-driven 3D Indoor Scene Evolution

A Survey of 3D Indoor Scene Synthesis

Planner3D: LLM-enhanced graph prior meets 3D indoor scene explicit regularization

Adaptive synthesis of indoor scenes via activity-associated object relation graphs.

Learning 3D Scene Priors with 2D Supervision

S-INF: Towards Realistic Indoor Scene Synthesis via Scene Implicit Neural Field

Active Arrangement of Small Objects in 3D Indoor Scenes

FairScene: Learning Unbiased Object Interactions for Indoor Scene Synthesis

Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesis

A System of Configurable 3D Indoor Scene Synthesis Via Semantic Relation Learning

Human-centric Indoor Scene Synthesis Using Stochastic Grammar

RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture

Estimating Spatial Layout of Cluttered Rooms by Using Object Prior and Spatial Constraints

Style-compatible Object Recommendation for Multi-room Indoor Scene Synthesis

Indoor Scene Generation from a Collection of Semantic-Segmented Depth Images

Style-Consistent 3D Indoor Scene Synthesis with Decoupled Objects