Abstract:Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association or incorrect detections from signal processing and machine learning methods. This article introduces two unifying formulations for outlier-robust estimation, generalized maximum consensus ($ ext{G}$-$ ext{MC}$) and generalized truncated least squares ($ ext{G-TLS}$), and investigates fundamental limits, practical algorithms, and applications. Our first contribution is a proof that outlier-robust estimation is inapproximable: In the worst case, it is impossible to (even approximately) find the set of outliers, even with slower-than-polynomial-time algorithms (particularly, algorithms running in quasi-polynomial time). As a second contribution, we review and extend two general-purpose algorithms. The first, adaptive trimming ($ ext{ADAPT}$), is combinatorial and is suitable for $ ext{G}$-$ ext{MC}$; the second, graduated nonconvexity ($ ext{GNC}$), is based on homotopy methods and is suitable for $ ext{G-TLS}$. We extend $ ext{ADAPT}$ and $ ext{GNC}$ to the case where the user does not have prior knowledge of the inlier-noise statistics (or the statistics may vary over time) and is unable to guess a reasonable threshold to separate inliers from outliers (as the one commonly used in RANdom SAmple Consensus $( ext{RANSAC})$. We propose the first minimally tuned algorithms for outlier rejection, which dynamically decide how to separate inliers from outliers. Our third contribution is an evaluation of the proposed algorithms on robot perception problems: mesh registration, image-based object detection (shape alignment), and pose graph optimization. $ ext{ADAPT}$ and $ ext{GNC}$ execute in real time, are deterministic, outperform $ ext{RANSAC}$, and are robust up to 8090 outliers. Their minimally tuned versions also compare favorably with the state of the art, even though they do not rely on a noise bound for the inliers.

DETECTION OF MULTIPLE OUTLIERS BY RANDOM ROBUST TESTING

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Outlier-Robust Estimation: Hardness, Minimally Tuned Algorithms, and Applications

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

A New Outlier Detection Method Considering Outliers As Model Errors

COMPARISONS BETWEEN ROBUST REGRESSION APPROACHES IN THE PRESENCE OF OUTLIERS AND HIGH LEVERAGE POINTS

A Robust Adaptive Modified Maximum Likelihood Estimator for the Linear Regression Model

Universal Robust Regression via Maximum Mean Discrepancy

Efficient and Robust Estimation of Linear Regression with Normal Errors

Outlier detection and robust variable selection via the penalized weighted LAD-LASSO method

Robustness Auditing for Linear Regression: To Singularity and Beyond

Robust Liu Estimator Used to Combat Some Challenges in Partially Linear Regression Model by Improving LTS Algorithm Using Semidefinite Programming

Large Dimensional Analysis of Robust M-Estimators of Covariance with Outliers

Robust Hypothesis Testing Using Wasserstein Uncertainty Sets

Robust Dawoud–Kibria estimator for handling multicollinearity and outliers in the linear regression model

A Robust Learning Approach for Regression Models Based on Distributionally Robust Optimization.

Doubly Robust Smoothing of Dynamical Processes via Outlier Sparsity Constraints

A Distributionally Robust Optimization Approach for Outlier Detection *

Robust regression via error tolerance

Robust Bayesian Inference for Moving Horizon Estimation

A novel robust moving horizon estimator for discrete-time linear systems subject to measurement outliers