Change Detection Needs Change Information: Improving Deep 3-D Point Cloud Change Detection

Iris de Gélis,Thomas Corpetti,Sébastien Lefèvre
DOI: https://doi.org/10.1109/tgrs.2024.3359484
IF: 8.2
2024-02-10
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Change detection is an important task that rapidly identifies modified areas, particularly when multitemporal data are concerned. In landscapes with complex geometry (e.g., urban environments), vertical information is a very useful source of knowledge that highlights changes and classifies them into different categories. In this study, we focus on change segmentation using raw 3-D point clouds (PCs) directly to avoid any information loss due to the rasterization processes. While deep learning has recently proven its effectiveness for this particular task by encoding the information through Siamese networks, we investigate herein the idea of also using change information in the early steps of deep networks. To do this, we first propose to provide a Siamese kernel point convolution (KPConv) state-of-the-art (SoTA) network with hand-crafted features, especially a change-related one, which improves the mean of the intersection over union (IoU) over the classes of change by 4.70%. Considering that a major improvement is obtained due to the change-related feature, we then propose three new architectures to address 3-D PC change segmentation: OneConvFusion, Triplet KPConv, and Encoder Fusion SiamKPConv. All these networks consider the change information in the early steps and outperform the SoTA methods. In particular, Encoder Fusion SiamKPConv overtakes the SoTA approaches by more than 5% of the mean of the IoU over the classes of change, emphasizing the value of having the network focus on change information for the change detection task. The code is available at https://github.com/IdeGelis/torch-points3d-SiamKPConvVariants.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?