Abstract:A problem of estimating linear regression equations by the least absolute deviations method is considered. The exact methods of implementation of the method are significantly inferior in performance to the least square method. The fastest algorithm based on coordinate descent along nodal straight lines has a computational complexity proportional to the square of the number of observations, which limits the practical application of the method to monitoring and diagnostic tasks. The goal of the study is to describe a faster version of the descent along the nodal straight lines, as well as to evaluate the performance. Reduction of the computational costs is achieved due to the fact that instead of calculating the values of the objective function at nodal points, we find the derivative of the objective function in the vicinity of these points along the nodal line. The computational efficiency of gradient descent along nodal straight lines is estimated. For a typical computer, a comparative analysis of the average calculation time for various algorithms of descent along nodal straight lines is performed. A simple example is given to illustrate the implementation of a gradient descent procedure. Along with reduction of the computational costs, we also eliminated the possibility of accumulating computational errors when determining the values of the objective function for large samples. Moreover, gradient descent is quite simple for implementation. This makes it possible to use the method of least absolute deviations as an alternative to the least square method in various practical applications.

A Direction Optimization Least Mean Square Algorithm

A Novel Fractional Order Normalized Lms Algorithm with Direction Optimization

Optimal Step-Size Update Equation in Nonstationary Environment and OVS-LMSII Algorithm

Iteration-based Variable Step-size LMS Algorithm and Its Performance Analysis

Optimal Variable Step-Size Lms Model and Algorithm with Independence Assumption

A Modified LMS Algorithm

A New Variable Step Size LMS Algorithm with Application to Active Noise Control

Research on a New LMS Algorithm with Variable Steplength

Black-box Optimization Algorithms for Regularized Least-squares Problems

A New Variable Step-Size LMS Algorithm Based on Piecewise Function

A New Fast Adaptive Linearized Alternating Direction Multiplier Method for Convex Optimization

A Novel Modified Fractional Order LMS Algorithm

LMS Algorithm with Gradient Descent Filter Length

R-Linear Convergence of Limited Memory Steepest Descent

QR-based Least Mean Squares Algorithm Using the Delta Operator

A Fast Block Coordinate Descent Method for Solving Linear Least-Squares Problems

An inertial Dai-Liao conjugate method for convex constrained monotone equations that avoids the direction of maximum magnification

Variable Step Size LMS Adaptive Algorithm Based on Exponential Function

Algorithms for descent along nodal straight lines in the problem of estimating regression equations using the least absolute deviations method

Linearly convergent adjoint free solution of least squares problems by random descent

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines