Abstract:We present three methods for distributed memory parallel inverse factorization of block-sparse Hermitian positive definite matrices. The three methods are a recursive variant of the AINV inverse Cholesky algorithm, iterative refinement, and localized inverse factorization, respectively. All three methods are implemented using the Chunks and Tasks programming model, building on the distributed sparse quad-tree matrix representation and parallel matrix-matrix multiplication in the publicly available Chunks and Tasks Matrix Library (CHTML). Although the algorithms are generally applicable, this work was mainly motivated by the need for efficient and scalable inverse factorization of the basis set overlap matrix in large scale electronic structure calculations. We perform various computational tests on overlap matrices for quasi-linear Glutamic Acid-Alanine molecules and three-dimensional water clusters discretized using the standard Gaussian basis set STO-3G with up to more than 10 million basis functions. We show that for such matrices the computational cost increases only linearly with system size for all the three methods. We show both theoretically and in numerical experiments that the methods based on iterative refinement and localized inverse factorization outperform previous parallel implementations in weak scaling tests where the system size is increased in direct proportion to the number of processes. We show also that compared to the method based on pure iterative refinement the localized inverse factorization requires much less communication.

A New Algorithm for Computing Disjoint Orthogonal Components in the Parallel Factor Analysis Model with Simulations and Applications to Real-World Data

Strongly Hierarchical Factorization Machines and ANOVA Kernel Regression

Deterministic parallel analysis: An improved method for selecting factors and principal components

Permutation methods for factor analysis and PCA

Minimum average partial correlation and parallel analysis: The influence of oblique structures

Considering Horn’s Parallel Analysis from a Random Matrix Theory Point of View

Parallelization and scalability analysis of inverse factorization using the Chunks and Tasks programming model

Greedy Orthogonal Pivoting Algorithm for Non-Negative Matrix Factorization.

Sparse matrix methods for unbalanced multifactor analysis of variance and covariance

Computational Approaches for Exponential-Family Factor Analysis

Orthogonal inter-battery factor analysis

Improving the Use of Parallel Analysis by Accounting for Sampling Variability of the Observed Correlation Matrix

Comparative Study of Complex Parallel Factor Analysis and Parallel Factor Analysis

Orthogonal Component Analysis: A Fast Dimensionality Reduction Algorithm

Randomized algorithms for distributed computation of principal component analysis and singular value decomposition

Projected principal component analysis in factor models

Computationally efficient orthogonalization for pairwise comparisons method

High Dimensional Factor Analysis with Weak Factors

Manifold Principle Component Analysis for Large-Dimensional Matrix Elliptical Factor Model

A Fast Data-Oriented Algorithm for Principal Component Analysis

Time-Warped Sparse Non-negative Factorization for Functional Data Analysis