A Click-Based Interactive Segmentation Network for Point Clouds

Wentao Sun,Zhipeng Luo,Yiping Chen,Huxiong Li,Jose Marcato Jr,Wesley Nunes Gonealves,Jonathan Li

DOI: https://doi.org/10.1109/tgrs.2023.3323735

IF: 8.2

2023-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Interactive segmentation plays an essential role in several tasks involving point clouds. However, existing methods suffer from low segmentation accuracy and cannot adjust the segmentation results according to the user’s personal demands. This article presents a novel deep-learning (DL)-based interactive segmentation method, named click rough segmentation network (CRSNet), designed to handle point clouds. The method allows users to iteratively click to segment interesting objects. CRSNet consists of two key parts: a click rough segmentation (CRS) module and a feature extraction module. First, the CRS module transforms click operations into an appropriate representation to input into the feature extraction module. The CRS module takes raw point clouds and clicks operations as input and outputs 3-D Gaussian vectors and roughly segmented blocks, which adapt to different-sized and densely distributed objects in complex environments. Second, the feature extraction module, which uses a novel mix loss-based analysis algorithm, extracts deep features and obtains instance segmentation results. The module is highly compatible because its backbones can be replaced by different DL architectures. Experimental results on the Karlsruhe Institute of Technology and Toyota Technological Institute (KITTI), Apolloscape, Roadmarking, Scannet, and SemanticKITTI datasets show that our method outperforms state-of-the-art semantic segmentation methods with one click. Moreover, our method can generalize well to unseen objects and datasets.