Coarse-to-fine Segmentation for Indoor Scenes with Progressive Supervision

Youcheng Song,Zhengxing Sun,Yunjie Wu,Hongyan Li

DOI: https://doi.org/10.1016/j.cagd.2019.101775

IF: 1.368

2019-01-01

Computer Aided Geometric Design

Abstract:Three-dimensional indoor scene segmentation is highly difficult due to the natural hierarchical structures and complicated contextual relationships in the scenes. In this paper, a 3D scene segmentation method that uses a stacked network is proposed for utilizing the context and hierarchy in 3D scenes. The method consists of two parts: a stacked network and progressive supervision. The stacked network consists of multiple base segmentation networks, and each network's output is concatenated to the raw input as another network's input to provide a prior context. Progressive supervision includes a group of coarse-to-fine segmentation labels that are generated based on the spatial relationships among objects in the scene, and it forces the network to learn the hierarchy. The experimental results from a regular dataset and a complex dataset demonstrate that our progressive supervision is effective and that our method outperforms existing methods in complex scenes. (C) 2019 Elsevier B.V. All rights reserved.