Abstract:Instead of minimizing the sum of all $n$ squared residuals as the classical least squares (LS) does, Rousseeuw (1984) proposed to minimize the sum of $h$ ($n/2 \leq h < n$) smallest squared residuals, the resulting estimator is called least trimmed squares (LTS). The idea of the LTS is simple but its computation is challenging since no LS-type analytical computation formula exists anymore. Attempts had been made since its presence, the feasible solution algorithm (Hawkins (1994)), fastlts.f (Rousseeuw and Van Driessen (1999)), and FAST-LTS (Rousseeuw and Van Driessen (2006)), among others, are promising approximate algorithms. The latter two have been incorporated into R function ltsReg by Valentin Todorov. These algorithms utilize combinatorial- or subsampling- approaches. With the great software accessibility and fast speed, the LTS, enjoying many desired properties, has become one of the most popular robust regression estimators across multiple disciplines. This article proposes analytic approaches -- employing first-order derivative (gradient) and second-order derivative (Hessian matrix) of the objective function. Our approximate algorithms for the LTS are vetted in synthetic and real data examples. Compared with ltsReg -- the benchmark in robust regression and well-known for its speed, our algorithms are comparable (and sometimes even favorable) with respect to both speed and accuracy criteria. Other major contributions include (i) originating the uniqueness and the strong and Fisher consistency at empirical and population settings respectively; (ii) deriving the influence function in a general setting; (iii) re-establishing the asymptotic normality (consequently root-n consistency) of the estimator with a neat and general approach.

Robust Nonlinear LTS Estimation Method

Nonlinear Robust Modeling Base on Least Trimmed Squares Regression

Least squares support vector machine based partially linear model identification

Combined Algorithm for Time-Varying Systems Based on the Robust Min-Max and the Damped Least Squares Estimation

Robust Liu Estimator Used to Combat Some Challenges in Partially Linear Regression Model by Improving LTS Algorithm Using Semidefinite Programming

A model where the least trimmed squares estimator is maximum likelihood

New algorithms for computing the least trimmed squares estimator

Computing Nonlinear LTS Estimator Based on a Random Differential Evolution Strategy

Robust estimation in a nonlinear cointegration model

Nonlinear Recursive Minimum Model Error Estimation

Approximate Least Trimmed Sum of Squares Fitting and Applications in Image Analysis.

Novel Robust Least-Squares Estimator for Linear Dynamic Data Reconciliation

Robust Estimation of Parameters in Nonlinear Ordinary Differential Equation Models

Selecting Weight Iteration Method with Initial Value by LTS

Partial least trimmed squares regression

A Fast Algorithm for Robust Regression with Penalised Trimmed Squares

Least sum of squares of trimmed residuals regression

Robust State Estimation for Uncertain Discrete-Time Stochastic Systems with Missing Measurements

Novel Approach to Robust H_∞ State Estimation for Parametric Uncertainty

Fast algorithm for sparse least trimmed squares via trimmed-regularized reformulation

A Robust High-Order Mixed L2-Linfty Estimation for Linear-in-the-Parameters Models