Abstract:Simultaneous determination of sensor poses and scene geometry is a fundamental problem for robot vision that is often achieved by Bundle Adjustment (BA). This article presents an efficient and consistent bundle adjustment method for light detection and ranging (lidar) sensors. The method employs edge and plane features to represent the scene geometry, and directly minimizes the natural Euclidean distance from each raw point to the respective geometry feature. A nice property of this formulation is that the geometry features can be analytically solved, drastically reducing the dimension of the numerical optimization. To represent and solve the resultant optimization problem more efficiently, this paper then adopts and formalizes the concept of point cluster, which encodes all raw points associated to the same feature by a compact set of parameters, the point cluster coordinates. We derive the closed-form derivatives, up to the second order, of the BA optimization based on the point cluster coordinates and show their theoretical properties such as the null spaces and sparsity. Based on these theoretical results, this paper develops an efficient second-order BA solver. Besides estimating the lidar poses, the solver also exploits the second order information to estimate the pose uncertainty caused by measurement noises, leading to consistent estimates of lidar poses. Moreover, thanks to the use of point cluster, the developed solver fundamentally avoids the enumeration of each raw point in all steps of the optimization: cost evaluation, derivatives evaluation and uncertainty evaluation. The implementation of our method is open sourced to benefit the robotics community.

Revisiting Rolling Shutter Bundle Adjustment: Toward Accurate and Fast Solution.

RSL-BA: Rolling Shutter Line Bundle Adjustment

Bundle Adjustment for Monocular Visual Odometry Based on Detected Traffic Sign Features.

An Efficient Bundle Adjustment Approach for Stereo Visual Odometry with Pose Consensus

CoLi-BA: Compact Linearization Based Solver for Bundle Adjustment

Critical Parameter Consensus for Efficient Distributed Bundle Adjustment

Rba: Reduced Bundle Adjustment for Oblique Aerial Photogrammetry

Rolling-Shutter-Aware Differential SfM and Image Rectification

URS-NeRF: Unordered Rolling Shutter Bundle Adjustment for Neural Radiance Fields

Towards Nonlinear-Motion-Aware and Occlusion-Robust Rolling Shutter Correction

ICE-BA: Incremental, Consistent and Efficient Bundle Adjustment for Visual-Inertial SLAM

Fast Rolling Shutter Correction in the Wild

Efficient and Consistent Bundle Adjustment on Lidar Point Clouds

Relative Pose Estimation for Stereo Rolling Shutter Cameras

Learning Adaptive Warping for Real-World Rolling Shutter Correction

Single Image Rolling Shutter Removal with Diffusion Models

ParallaxBA: Bundle Adjustment Using Parallax Angle Feature Parametrization

RKHS-BA: A Robust Correspondence-Free Multi-View Registration Framework with Semantic Point Clouds

Context-Aware Video Reconstruction for Rolling Shutter Cameras

On Bundle Adjustment for Multiview PointCloud Registration