Sketch-aided Interactive Fusion Point Cloud Place Recognition

Ruonan Zhang,Xiaohang Liu,Ge Li,Thomas H. Li,Pengjun Zhao
DOI: https://doi.org/10.1145/3652583.3657613
2024-01-01
Abstract:Existing point cloud place recognition methods ignore textureless descriptions of scenes by point clouds. This further leads to lower generalization and bottlenecks in performance improvement. To solve these problems, we propose a novel sketch-aided interactive fusion point cloud place recognition method, which involves two networks to separately deal with point clouds and sketches and an interaction feature fused module to fuse features mathematically. Specifically, this is the first time to introduce sketches to guide the point cloud place recognition task as far as we know. The sketch-aided part and the point cloud could enhance the texture structure of the scene which is omitted in only the point cloud scenario. Meanwhile, we devise an interactive feature fusion module for fusing two features, which is encouraged by square summation in math. This module reflects the communication between features as well as the non-linear influence on the fused feature without bringing dimension growth. The experiments on two datasets witness the effectiveness of the proposed method in performance improvement and generalization subjectively and objectively.
What problem does this paper attempt to address?