RKHS-BA: A Robust Correspondence-Free Multi-View Registration Framework with Semantic Point Clouds

Ray Zhang,Jingwei Song,Xiang Gao,Junzhe Wu,Tianyi Liu,Jinyuan Zhang,Ryan Eustice,Maani Ghaffari
2024-12-01
Abstract:This work reports a novel multi-frame Bundle Adjustment (BA) framework called RKHS-BA. It uses continuous landmark representations that encode RGB-D/LiDAR and semantic observations in a Reproducing Kernel Hilbert Space (RKHS). With a correspondence-free pose graph formulation, the proposed system constructs a loss function that achieves more generalized convergence than classical point-wise convergence. We demonstrate its applications in multi-view point cloud registration, sliding-window odometry, and global LiDAR mapping on simulated and real data. It shows highly robust pose estimations in extremely noisy scenes and exhibits strong generalization with various types of semantic inputs. The open source implementation is released in <a class="link-external link-https" href="https://github.com/UMich-CURLY/RKHS_BA" rel="external noopener nofollow">this https URL</a>.
Robotics
What problem does this paper attempt to address?