SHRAG: Semantic Hierarchical Graph for Floorplan Representation

Jiongchao Jin,Zhou Xue,Biao Leng
DOI: https://doi.org/10.1109/3dv57658.2022.00039
2022-01-01
Abstract:Representation learning from a floorplan is a fundamental step for various floorplan-related applications, such as retrieval, reconstruction, and generation. Previous works often use single-layer graphs to model room categories and adjacencies as nodes and edges, which can only represent a floorplan in a coarse level without detailed information such as room shape and door/window locations. Thus, we propose SHRAG, a hierarchical semantic graph for floor-plan representation, with two hierarchical graph modules to semantically encode both coarse and detailed information of a floorplan. First, a Detail Graph Module(DGM) was designed to learn detailed contour and attachable elements embedding for each room. Then, a Global Graph Module(GGM) was applied to concatenate and encode both detailed embeddings from DGM and coarse information including room categories and room relations. Results show that the representation learned from SHRAG achieved SOTA on floorplan retrieval tasks. Further, SHRAG performs more satisfying than other floorplan similarity metrics in a comprehensive user study. We also demonstrate that SHRAG can be easily adapted to real-world complex indoor scenes even with furniture.
What problem does this paper attempt to address?