Abstract:We propose a robust approach for the registration of two sets of 3D points in the presence of a large amount of outliers. Our first contribution is to reformulate the registration problem using a Truncated Least Squares (TLS) cost that makes the estimation insensitive to a large fraction of spurious point-to-point correspondences. The second contribution is a general framework to decouple rotation, translation, and scale estimation, which allows solving in cascade for the three transformations. Since each subproblem (scale, rotation, and translation estimation) is still non-convex and combinatorial in nature, out third contribution is to show that (i) TLS scale and (component-wise) translation estimation can be solved exactly and in polynomial time via an adaptive voting scheme, (ii) TLS rotation estimation can be relaxed to a semidefinite program and the relaxation is tight in practice, even in the presence of an extreme amount of outliers. We validate the proposed algorithm, named TEASER (Truncated least squares Estimation And SEmidefinite Relaxation), in standard registration benchmarks showing that the algorithm outperforms RANSAC and robust local optimization techniques, and favorably compares with Branch-and-Bound methods, while being a polynomial-time algorithm. TEASER can tolerate up to 99% outliers and returns highly-accurate solutions.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve robust registration between two 3D point sets in the presence of a large number of outliers. Specifically, the paper focuses on how to efficiently and accurately estimate rotation, translation, and scale transformation to align two 3D point clouds when the correspondence contains an extremely high proportion of outliers (for example, 99% of the measured data may be outliers). This problem is of great significance in robotics and computer vision, especially when dealing with object pose estimation in cluttered scenes. Due to the limitations of 3D keypoint detection and matching techniques, a high proportion of outliers is a common phenomenon. ### Main contributions of the paper 1. **Redefine the registration problem using the Truncated Least Squares (TLS) cost function**: - The paper proposes a new registration method. By introducing the Truncated Least Squares (TLS) cost function, the estimation process is made insensitive to a large number of incorrect point - to - point correspondences. This enables the algorithm to remain robust in the presence of a large number of outliers. 2. **A general framework for decoupling rotation, translation, and scale estimation**: - The author proposes a general framework that can decouple the estimation of rotation, translation, and scale, thus allowing these three sub - problems to be solved sequentially. This decoupling method not only simplifies the problem but also improves the efficiency of the algorithm. 3. **Prove that each sub - problem can be accurately solved in polynomial time**: - For scale and translation estimation, the paper proposes an adaptive voting scheme that can accurately solve the problem in polynomial time. - For rotation estimation, the paper uses the Semidefinite Programming (SDP) relaxation method to transform the non - convex problem into a convex problem and proves that this relaxation method is tight even in the presence of a large number of outliers. ### Algorithm overview The algorithm proposed in the paper is called TEASER (Truncated least squares Estimation And SEmidefinite Relaxation), and its main steps are as follows: 1. **Scale estimation**: - Use Translation - Invariant Measurement (TIM) and Translation - Rotation - Invariant Measurement (TRIM) to estimate the scale. - Solve the scale estimation problem in polynomial time through the Adaptive Voting algorithm. 2. **Rotation estimation**: - Use the estimated scale and TIM to estimate the rotation. - Transform the non - convex rotation estimation problem into a convex problem through the Semidefinite Programming (SDP) relaxation method and solve it. 3. **Translation estimation**: - Use the estimated scale and rotation to estimate the translation. - Solve the translation estimation problem in polynomial time through the Component - Independent Truncated Least Squares (TLS) method. ### Experimental verification The paper verifies the performance of the TEASER algorithm on standard registration benchmark datasets and robot datasets. The experimental results show that the TEASER algorithm can still provide high - precision registration results when dealing with extreme outlier rates (up to 99%), and is superior to existing RANSAC and local optimization methods in terms of running time. ### Related work The paper also reviews related 3D point cloud registration methods, including correspondence - based methods and methods for simultaneously estimating pose and correspondence. These methods perform well in the case of low noise and low outlier rates, but often perform poorly in the case of high outlier rates. The TEASER algorithm overcomes the limitations of these methods by introducing the TLS cost function and the decoupling framework, achieving robust registration at extreme outlier rates. ### Summary This paper proposes a robust and efficient 3D point cloud registration method in the presence of a large number of outliers by introducing a new TLS cost function and a decoupling framework. The TEASER algorithm not only has polynomial - time complexity in theory but also performs well in practical applications. It can tolerate up to 99% of outliers and provide high - precision registration results.

A Polynomial-time Solution for Robust Registration with Extreme Outlier Rates

TEASER: Fast and Certifiable Point Cloud Registration

Accurate Range Image Registration: Eliminating or Modelling Outliers

Scalable 3D Registration via Truncated Entry-wise Absolute Residuals

A New Method for Registration of 3d Point Sets with Low Overlapping Ratios

An Accurate and Robust Registration Framework Based on Outlier Removal and Feature Point Adjustment for Remote Sensing Images

Practical, Fast and Robust Point Cloud Registration for 3D Scene Stitching and Object Localization

An Effective Point Cloud Registration Method Based on Robust Removal of Outliers

A Novel Image Registration Method Based on Geometrical Outlier Removal

Robust consensus-aware network for 3D point registration

Efficient and Robust Point Cloud Registration via Heuristics-guided Parameter Search

SGOR: Outlier Removal by Leveraging Semantic and Geometric Information for Robust Point Cloud Registration

One Ring to Rule Them All: Certifiably Robust Geometric Perception with Outliers

Efficient Similarity Point Set Registration by Transformation Decomposition

An Automatic Registration Approach to Laser Point Sets Based on Multidiscriminant Parameter Extraction

Quasi-Newton Solver for Robust Non-Rigid Registration

RANSAC Back to SOTA: A Two-stage Consensus Filtering for Real-time 3D Registration

PCR-99: A Practical Method for Point Cloud Registration with 99 Percent Outliers

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

Robust point cloud registration using Hough voting-based correspondence outlier rejection