Abstract:Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association or incorrect detections from signal processing and machine learning methods. This article introduces two unifying formulations for outlier-robust estimation, generalized maximum consensus ($ ext{G}$-$ ext{MC}$) and generalized truncated least squares ($ ext{G-TLS}$), and investigates fundamental limits, practical algorithms, and applications. Our first contribution is a proof that outlier-robust estimation is inapproximable: In the worst case, it is impossible to (even approximately) find the set of outliers, even with slower-than-polynomial-time algorithms (particularly, algorithms running in quasi-polynomial time). As a second contribution, we review and extend two general-purpose algorithms. The first, adaptive trimming ($ ext{ADAPT}$), is combinatorial and is suitable for $ ext{G}$-$ ext{MC}$; the second, graduated nonconvexity ($ ext{GNC}$), is based on homotopy methods and is suitable for $ ext{G-TLS}$. We extend $ ext{ADAPT}$ and $ ext{GNC}$ to the case where the user does not have prior knowledge of the inlier-noise statistics (or the statistics may vary over time) and is unable to guess a reasonable threshold to separate inliers from outliers (as the one commonly used in RANdom SAmple Consensus $( ext{RANSAC})$. We propose the first minimally tuned algorithms for outlier rejection, which dynamically decide how to separate inliers from outliers. Our third contribution is an evaluation of the proposed algorithms on robot perception problems: mesh registration, image-based object detection (shape alignment), and pose graph optimization. $ ext{ADAPT}$ and $ ext{GNC}$ execute in real time, are deterministic, outperform $ ext{RANSAC}$, and are robust up to 8090 outliers. Their minimally tuned versions also compare favorably with the state of the art, even though they do not rely on a noise bound for the inliers.

R-estimation in linear models: algorithms, complexity, challenges

Robust Partial Least Squares Regression: Part II, New Algorithm and Benchmark Studies

Robust multi-stage model-based design of optimal experiments for nonlinear estimation

Online and Offline Robust Multivariate Linear Regression

Efficient and Robust Estimation of Linear Regression with Normal Errors

Computationally Efficient and Statistically Optimal Robust Low-rank Matrix Estimation

The estimation error of general first order methods

Novel Robust Least-Squares Estimator for Linear Dynamic Data Reconciliation

Elegant robustification of sparse partial least squares by robustness-inducing transformations

THE METHOD OF RANK-BASED ROBUST REGRESSION ANALYSIS

Outlier-Robust Estimation: Hardness, Minimally Tuned Algorithms, and Applications

Computationally Efficient and Statistically Optimal Robust Low-rank Matrix and Tensor Estimation

Optimal Robust Linear Regression in Nearly Linear Time

Randomized Kaczmarz Algorithm for Inconsistent Linear Systems: An Exact MSE Analysis

Robust Partial Least Squares Regression: Part I, Algorithmic Developments

A Robust Adaptive Modified Maximum Likelihood Estimator for the Linear Regression Model

Probabilistic Robustness Analysis—Risks, Complexity, and Algorithms

Estimation and Inference by Stochastic Optimization: Three Examples

M-estimation for linear models with exchangeable errors

Treatment of Statistical Estimation Problems in Randomized Smoothing for Adversarial Robustness

Unified robust estimation