Abstract:Instead of minimizing the sum of all $n$ squared residuals as the classical least squares (LS) does, Rousseeuw (1984) proposed to minimize the sum of $h$ ($n/2 \leq h < n$) smallest squared residuals, the resulting estimator is called least trimmed squares (LTS). The idea of the LTS is simple but its computation is challenging since no LS-type analytical computation formula exists anymore. Attempts had been made since its presence, the feasible solution algorithm (Hawkins (1994)), fastlts.f (Rousseeuw and Van Driessen (1999)), and FAST-LTS (Rousseeuw and Van Driessen (2006)), among others, are promising approximate algorithms. The latter two have been incorporated into R function ltsReg by Valentin Todorov. These algorithms utilize combinatorial- or subsampling- approaches. With the great software accessibility and fast speed, the LTS, enjoying many desired properties, has become one of the most popular robust regression estimators across multiple disciplines. This article proposes analytic approaches -- employing first-order derivative (gradient) and second-order derivative (Hessian matrix) of the objective function. Our approximate algorithms for the LTS are vetted in synthetic and real data examples. Compared with ltsReg -- the benchmark in robust regression and well-known for its speed, our algorithms are comparable (and sometimes even favorable) with respect to both speed and accuracy criteria. Other major contributions include (i) originating the uniqueness and the strong and Fisher consistency at empirical and population settings respectively; (ii) deriving the influence function in a general setting; (iii) re-establishing the asymptotic normality (consequently root-n consistency) of the estimator with a neat and general approach.

rlsm: R package for least squares Monte Carlo

Linear regression with stationary errors : the R package slm

An Extendable Python Implementation of Robust Optimisation Monte Carlo

An Extendable Python Implementation of Robust Optimization Monte Carlo

Flexible Modified LSMR Method for Least Squares Problems

Fast, effective, and coherent time series modeling using the sparsity-ranked lasso

RSSL: Semi-supervised Learning in R

New algorithms for computing the least trimmed squares estimator

SIHR: An R Package for Statistical Inference in High-dimensional Linear and Logistic Regression Models

A computer algebra system for R: Macaulay2 and the m2r package

Generalized Forgetting Recursive Least Squares: Stability and Robustness Guarantees

lspartition: Partitioning-Based Least Squares Regression

RRLS : Robust Reinforcement Learning Suite

Sketch 'n Solve: An Efficient Python Package for Large-Scale Least Squares Using Randomized Numerical Linear Algebra

Reinforcement Learning in R

Carlo.jl: A general framework for Monte Carlo simulations in Julia

Extending the statistical software package Engine for Likelihood-Free Inference

fairml: A Statistician's Take on Fair Machine Learning Modelling

A rigorous introduction to linear models

Weighted least squares regression with the best robustness and high computability

L0Learn: A Scalable Package for Sparse Learning using L0 Regularization