Abstract:We consider the problem of optimizing the parameter of a two-stage algorithm for approximate solution of a system of linear algebraic equations with a sparse $n\times n$-matrix, i.e., with one in which the number of nonzero elements is $m\!=\!O(n)$. The two-stage algorithm uses conjugate gradient method at its stages. At the 1st stage, an approximate solution with accuracy $\varepsilon_1$ is found for zero initial vector. All numerical values used at this stage are represented as single-precision numbers. The obtained solution is used as initial approximation for an approximate solution with a given accuracy $\varepsilon_2$ that we obtain at the 2nd stage, where double-precision numbers are used. Based on the values of some matrix parameters, computed in a time not exceeding $O(m)$, we need to determine the value $\varepsilon_1$ which minimizes the total computation time at two stages. Using single-precision numbers for computations at the 1st stage is advantageous, since the execution time of one iteration will be approximately half that of one iteration at the 2nd stage. At the same time, using machine numbers with half the mantissa length accelerates the growth of the rounding error per iteration of the conjugate gradient method at the 1st stage, which entails an increase in the number of iterations performed at 2nd stage. As parameters that allow us to determine $\varepsilon_1$ for the input matrix, we use $n$, $m$, an estimate of the diameter of the graph associated with the matrix, an estimate of the spread of the matrix' eigenvalues, and estimates of its maximum eigenvalue. The optimal or close to the optimal value of $\varepsilon_1$ can be determined for matrix with such a vector of parameters using the nearest neighbor regression or some other type of regression.

Minimization of the Pseudospectral Abscissa of a Quadratic Matrix Polynomial

Large-Scale Minimization of the Pseudospectral Abscissa

Parameter optimization for restarted mixed precision iterative sparse solver

Polynomial argmin for recovery and approximation of multivariate discontinuous functions

Optimal Polynomial Smoothers for Parallel AMG

Sparse Polynomial Matrix Optimization

Approximation Accuracy of the Krylov Subspaces for Linear Discrete Ill-Posed Problems

Minimizing the Condition Number to Construct Design Points for Polynomial Regression Models

A Padé Approximate Linearization Algorithm for Solving the Quadratic Eigenvalue Problem with Low‐rank Damping

Low-Rank Matrix Iteration Using Polynomial-Filtered Subspace Extraction.

Lp quasi-norm minimization: algorithm and applications

A Feasible Method for Optimization with Orthogonality Constraints

Computing $f(A)b$ via Least Squares Polynomial Approximations

Parametric PDEs: Sparse or Low-Rank Approximations?

On a minimization problem of the maximum generalized eigenvalue: properties and algorithms

A continuous approach for computing the pseudospectra of linear operators

S-SOS: Stochastic Sum-Of-Squares for Parametric Polynomial Optimization

An Arnoldi-based approach to polynomial and rational least squares problems

Least Squares Solution with the Minimum-Norm to General Matrix Equations Via Iteration.

Quasi-Newton methods for minimizing a quadratic function subject to uncertainty