Abstract:Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association or incorrect detections from signal processing and machine learning methods. This article introduces two unifying formulations for outlier-robust estimation, generalized maximum consensus ($ ext{G}$-$ ext{MC}$) and generalized truncated least squares ($ ext{G-TLS}$), and investigates fundamental limits, practical algorithms, and applications. Our first contribution is a proof that outlier-robust estimation is inapproximable: In the worst case, it is impossible to (even approximately) find the set of outliers, even with slower-than-polynomial-time algorithms (particularly, algorithms running in quasi-polynomial time). As a second contribution, we review and extend two general-purpose algorithms. The first, adaptive trimming ($ ext{ADAPT}$), is combinatorial and is suitable for $ ext{G}$-$ ext{MC}$; the second, graduated nonconvexity ($ ext{GNC}$), is based on homotopy methods and is suitable for $ ext{G-TLS}$. We extend $ ext{ADAPT}$ and $ ext{GNC}$ to the case where the user does not have prior knowledge of the inlier-noise statistics (or the statistics may vary over time) and is unable to guess a reasonable threshold to separate inliers from outliers (as the one commonly used in RANdom SAmple Consensus $( ext{RANSAC})$. We propose the first minimally tuned algorithms for outlier rejection, which dynamically decide how to separate inliers from outliers. Our third contribution is an evaluation of the proposed algorithms on robot perception problems: mesh registration, image-based object detection (shape alignment), and pose graph optimization. $ ext{ADAPT}$ and $ ext{GNC}$ execute in real time, are deterministic, outperform $ ext{RANSAC}$, and are robust up to 8090 outliers. Their minimally tuned versions also compare favorably with the state of the art, even though they do not rely on a noise bound for the inliers.

Effects of Outliers on the Maximum Correntropy Estimation: A Robustness Analysis

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Robust variable kernel width for maximum correntropy criterion algorithm

Large Dimensional Analysis of Robust M-Estimators of Covariance with Outliers

Adaptive sparseness for correntropy-based robust regression via automatic relevance determination

Maximum correntropy criterion based sparse adaptive filtering algorithms for robust channel estimation under non-Gaussian environments

Robust Principal Component Analysis Based On Maximum Correntropy Power Iterations

Outlier-robust Mean Estimation near the Breakdown Point via Sum-of-Squares

Outlier-Robust Estimation: Hardness, Minimally Tuned Algorithms, and Applications

Stable Outlier-Robust Signal Recovery Over Networks: A Convex Analytic Approach Using Minimax Concave Loss

Robust Hammerstein Adaptive Filtering under Maximum Correntropy Criterion

Proportionate Recursive Maximum Correntropy Criterion Adaptive Filtering Algorithms and their Performance Analysis

Minimum Covariance Determinant: Spectral Embedding and Subset Size Determination

Constrained maximum correntropy adaptive filtering

Minimum Total Error Entropy Method for Parameter Estimation

Maximum Likelihood Inference in Robust Linear Mixed-Effects Models Using Multivariate T Distributions

Robust covariance estimation and explainable outlier detection for matrix-valued data

Robust small area estimation for unit level model with density power divergence

Outlier Robust and Sparse Estimation of Linear Regression Coefficients

Universal Robust Regression via Maximum Mean Discrepancy