Abstract:Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association or incorrect detections from signal processing and machine learning methods. This article introduces two unifying formulations for outlier-robust estimation, generalized maximum consensus ($ ext{G}$-$ ext{MC}$) and generalized truncated least squares ($ ext{G-TLS}$), and investigates fundamental limits, practical algorithms, and applications. Our first contribution is a proof that outlier-robust estimation is inapproximable: In the worst case, it is impossible to (even approximately) find the set of outliers, even with slower-than-polynomial-time algorithms (particularly, algorithms running in quasi-polynomial time). As a second contribution, we review and extend two general-purpose algorithms. The first, adaptive trimming ($ ext{ADAPT}$), is combinatorial and is suitable for $ ext{G}$-$ ext{MC}$; the second, graduated nonconvexity ($ ext{GNC}$), is based on homotopy methods and is suitable for $ ext{G-TLS}$. We extend $ ext{ADAPT}$ and $ ext{GNC}$ to the case where the user does not have prior knowledge of the inlier-noise statistics (or the statistics may vary over time) and is unable to guess a reasonable threshold to separate inliers from outliers (as the one commonly used in RANdom SAmple Consensus $( ext{RANSAC})$. We propose the first minimally tuned algorithms for outlier rejection, which dynamically decide how to separate inliers from outliers. Our third contribution is an evaluation of the proposed algorithms on robot perception problems: mesh registration, image-based object detection (shape alignment), and pose graph optimization. $ ext{ADAPT}$ and $ ext{GNC}$ execute in real time, are deterministic, outperform $ ext{RANSAC}$, and are robust up to 8090 outliers. Their minimally tuned versions also compare favorably with the state of the art, even though they do not rely on a noise bound for the inliers.

Noise Statistics Oblivious GARD For Robust Regression With Sparse Outliers

Analysis Non-Sparse Recovery for Relaxed ALASSO

Low Rank Matrix Recovery with Adversarial Sparse Noise

Outlier-Robust Estimation: Hardness, Minimally Tuned Algorithms, and Applications

Robust Non-linear Regression: A Greedy Approach Employing Kernels with Application to Image Denoising

Low-Rank-Sparse Subspace Representation for Robust Regression

Computationally Efficient and Statistically Optimal Robust High-Dimensional Linear Regression

A Robust Recovery Algorithm with Smoothing Strategies.

EMORF/S: EM-Based Outlier-Robust Filtering and Smoothing With Correlated Measurement Noise

Robust Sparse Gaussian Process Regression for Soft Sensing in Industrial Big Data Under the Outlier Condition

Robust RLS Via the Nonconvex Sparsity Prompting Penalties of Outlier Components.

Robust Sparse Regression with Non-Isotropic Designs

Robust Sparse Recovery Via Weakly Convex Optimization in Impulsive Noise

Weakly Convex Regularized Robust Sparse Recovery Methods with Theoretical Guarantees

On the Optimality of Backward Regression: Sparse Recovery and Subset Selection

Robust Sparse Recovery via Weakly Convex Regularization

Computationally Efficient and Statistically Optimal Robust Low-rank Matrix and Tensor Estimation

Outlier-robust sparse/low-rank least-squares regression and robust matrix completion

Sparse and Robust Linear Regression: An Optimization Algorithm and Its Statistical Properties

Outlier Robust and Sparse Estimation of Linear Regression Coefficients