Abstract:Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association or incorrect detections from signal processing and machine learning methods. This article introduces two unifying formulations for outlier-robust estimation, generalized maximum consensus ($ ext{G}$-$ ext{MC}$) and generalized truncated least squares ($ ext{G-TLS}$), and investigates fundamental limits, practical algorithms, and applications. Our first contribution is a proof that outlier-robust estimation is inapproximable: In the worst case, it is impossible to (even approximately) find the set of outliers, even with slower-than-polynomial-time algorithms (particularly, algorithms running in quasi-polynomial time). As a second contribution, we review and extend two general-purpose algorithms. The first, adaptive trimming ($ ext{ADAPT}$), is combinatorial and is suitable for $ ext{G}$-$ ext{MC}$; the second, graduated nonconvexity ($ ext{GNC}$), is based on homotopy methods and is suitable for $ ext{G-TLS}$. We extend $ ext{ADAPT}$ and $ ext{GNC}$ to the case where the user does not have prior knowledge of the inlier-noise statistics (or the statistics may vary over time) and is unable to guess a reasonable threshold to separate inliers from outliers (as the one commonly used in RANdom SAmple Consensus $( ext{RANSAC})$. We propose the first minimally tuned algorithms for outlier rejection, which dynamically decide how to separate inliers from outliers. Our third contribution is an evaluation of the proposed algorithms on robot perception problems: mesh registration, image-based object detection (shape alignment), and pose graph optimization. $ ext{ADAPT}$ and $ ext{GNC}$ execute in real time, are deterministic, outperform $ ext{RANSAC}$, and are robust up to 8090 outliers. Their minimally tuned versions also compare favorably with the state of the art, even though they do not rely on a noise bound for the inliers.

Some issues in robust clustering

Finding Outliers in Gaussian Model-based Clustering

A Robust Spectral Clustering Algorithm for Sub-Gaussian Mixture Models with Outliers

Adversarially robust clustering with optimality guarantees

Robust Fair Clustering with Group Membership Uncertainty Sets

Robust Subspace Clustering Via Thresholding Ridge Regression

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

Optimal Clustering under Uncertainty

Clustering with Confidence: Finding Clusters with Statistical Guarantees

A general theory for robust clustering via trimmed mean

Minimax Supervised Clustering in the Anisotropic Gaussian Mixture Model: A new take on Robust Interpolation

Robust clustering - an approach based on graph theory and objective function

A provable initialization and robust clustering method for general mixture models

Outliers Detection Is Not So Hard: Approximation Algorithms for Robust Clustering Problems Using Local Search Techniques

Robust continuous clustering

Robust clustering by pruning outliers

On Saving Outliers for Better Clustering over Noisy Data.

Flexible Clustering with a Sparse Mixture of Generalized Hyperbolic Distributions

Clustering Degree-Corrected Stochastic Block Model with Outliers

Gaussian Mixture Learning Via Robust Competitive Agglomeration

Outlier-Robust Estimation: Hardness, Minimally Tuned Algorithms, and Applications