Conditional Room Layout Generation Based on Graph Neural Networks

Zhihan Yao,Yuhang Chen,Jiahao Cui,Shoulong Zhang,Shuai Li,Aimin Hao

DOI: https://doi.org/10.1016/j.cag.2024.103971

IF: 1.821

2024-01-01

Computers & Graphics

Abstract:In this paper, we present a novel end-to-end variational generative model that utilizes graph-based latent representations for indoor scene synthesis at one time. In contrast to prior research, our method deviates from the practice of gradually introducing and arranging furniture in an empty room using autoregression. Instead, it focuses on acquiring a comprehensive implicit representation of the room’s original architectural structure and the placement of furniture. We initially transform the 3D room scene into a dense scene graph, where nodes correspond to the objects present in the room while edges reflect the spatial location links and functional correlations between objects. Then, a neural network is trained to acquire the graph-based latent representation of the room scene through iterative message passing, ultimately resulting in the acquisition of the data distribution on the latent space of the room layout. Given the architectural structure of an empty room as a prerequisite for scene synthesis, the generative model has the ability to sample from the prior distribution of the room’s latent representation. This allows the model to then decode and generate a variety of room layouts. We evaluate our method with the state-of-the-art 3D indoor scene dataset and generation methods. The experimental results demonstrate that our method achieves more rational and diverse outcomes in the context of generating scenes under specific conditions.