Abstract:The Conjugate Gradient (CG) method has been widely used to solve linear systems of the type when the matrix A is symmetric positive definitive. In the context of the implementation of CG as an iterative algorithm one important bottleneck is in the matrix vector multiplication which has the disadvantages of a low ratio of computation memory accesses. To improve this ratio several strategies have been researched ranging from new paradigm machine architectures to optimizing the cache data usage through the usage of a matrix multivector multiplications Kernel. The latter in the CG context yields the Block Conjugate Gradient (BCG) originally used to solve linear systems with multiple right -hand -side. A main drawback of BCG for the case of a single right hand side is the determination of an optimal block size. Moreover, if an adequate block size is not chosen the effect on the rate of convergence of the CG can be negative and consequently its rate of convergence deteriorates. In this work we compare strategies for determining adaptively the optimal block size in the implementation of BCG considering a single right hand side seeking a trade-off between convergence rate and computational cost. The strategies analyzed arc based on the Rayleigh Values associated to the search subspace, the associated Ritz Values, and the decay rate of the residual measured locally. Numerical experiments on real matrices arc presented. It is observed that the Ritz Values strategy shows better results than the other strategies in terms of decreasing the computational cost. These results encourage further analysis and design of adaptive block algorithms.

Varying The Block Size On Block Conjugate Gradient: Comparison Of Strategies

A Cooperative Conjugate Gradient Method for Linear Systems Permitting Efficient Multi-Thread Implementation

New Iterative Gridding Algorithm Using Conjugate Gradient Method

A Cooperative Conjugate Gradient Method for Linear Systems Permitting Multithread Implementation of Low Complexity

Block Acceleration Without Momentum: On Optimal Stepsizes of Block Gradient Descent for Least-Squares

Flexibly Enlarged Conjugate Gradient Methods

An Enhancement of the Accuracy of the BiCGStab Method for Solving Linear Systems with Single or Multiple Right-Hand Sides

On the Flexibility of Block Coordinate Descent for Large-Scale Optimization.

On global randomized block Kaczmarz algorithm for solving large-scale matrix equations

Enhancing data locality of the conjugate gradient method for high-order matrix-free finite-element implementations

Greedy Block Coordinate Descent for Large Scale Gaussian Process Regression

Practical Restrictively Preconditioned Conjugate Gradient Methods for a Class of Block Two-by-Two Linear Systems

A Variation on the Block Arnoldi Method for Large Unsymmetric Matrix Eigenproblems

Oxidized low density lipoproteins induce apoptosis in human lymphocytes: involvement of mitogen-activated protein kinases.

On the adaptive deterministic block coordinate descent methods with momentum for solving large linear least-squares problems

Randomized block coordinate descent method for linear ill-posed problems

On convergence of the block Lanczos method for the CDT subproblem

A spectrally preconditioned and initially deflated variant of the restarted block GMRES method for solving multiple right-hand sides linear systems

Permuted Orthogonal Block-Diagonal Transformation Matrices for Large Scale Optimization Benchmarking

The conjugate gradient method with various viewpoints