Abstract:Identifying the underlying model in a set of data contaminated by noise and outliers is a fundamental task in computer vision. The cost function associated with such tasks is often highly complex, hence in most cases only an approximate solution is obtained by evaluating the cost function on discrete locations in the parameter (hypothesis) space. To be successful at least one hypothesis has to be in the vicinity of the solution. Due to noise hypotheses generated by minimal subsets can be far from the underlying model, even when the samples are from the said structure. In this paper we investigate the feasibility of using higher than minimal subset sampling for hypothesis generation. Our empirical studies showed that increasing the sample size beyond minimal size ( p ), in particular up to p+2, will significantly increase the probability of generating a hypothesis closer to the true model when subsets are selected from inliers. On the other hand, the probability of selecting an all inlier sample rapidly decreases with the sample size, making direct extension of existing methods unfeasible. Hence, we propose a new computationally tractable method for robust model fitting that uses higher than minimal subsets. Here, one starts from an arbitrary hypothesis (which does not need to be in the vicinity of the solution) and moves until either a structure in data is found or the process is re-initialized. The method also has the ability to identify when the algorithm has reached a hypothesis with adequate accuracy and stops appropriately, thereby saving computational time. The experimental analysis carried out using synthetic and real data shows that the proposed method is both accurate and efficient compared to the state-of-the-art robust model fitting techniques.

Conditional selective inference for robust regression and outlier detection using piecewise-linear homotopy continuation

Homotopy continuation approaches for robust SV classification and regression

Outlier detection and robust variable selection via the penalized weighted LAD-LASSO method

Robust group non-convex estimations for high-dimensional partially linear models

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Exact Post-Selection Inference for Sequential Regression Procedures

Nonparametric Conditional Inference for Regression Coefficients with Application to Configural Polysampling

Selective Inference via Marginal Screening for High Dimensional Classification

Outlier Robust and Sparse Estimation of Linear Regression Coefficients

Sparse and Robust Linear Regression: An Optimization Algorithm and Its Statistical Properties

Risk-Based Robust Statistical Learning by Stochastic Difference-of-Convex Value-Function Optimization

Simultaneous feature selection and outlier detection with optimality guarantees

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Robust Model Fitting Using Higher Than Minimal Subset Sampling

More powerful post-selection inference, with application to the Lasso

Efficient Inference on High-Dimensional Linear Models with Missing Outcomes

High-dimensional robust inference for censored linear models

A Distributionally Robust Optimization Approach for Outlier Detection *

Bayesian Restricted Likelihood Methods: Conditioning on Insufficient Statistics in Bayesian Regression

Robust Liu Estimator Used to Combat Some Challenges in Partially Linear Regression Model by Improving LTS Algorithm Using Semidefinite Programming

Robust Inference for High-dimensional Linear Models with Heavy-tailed Errors via Partial Gini Covariance