On reducing i/o overheads in large-scale invariant subspace projections

Hasan Metin Aktulga,Chao Yang,Ümit V. Çatalyürek,Pieter Maris,James P. Vary,Esmond G. Ng
DOI: https://doi.org/10.1007/978-3-642-29737-3_35
2011-01-01
Abstract:Obtaining highly accurate predictions on properties of light atomic nuclei using the Configuration Interaction (CI) method requires computing the lowest eigenvalues and associated eigenvectors of a large many-body nuclear Hamiltonian, H. One particular approach, the J-scheme, requires the projection of the H matrix into an invariant subspace. Since the matrices can be very large, enormous computing power is needed while significant stresses are put on the memory and I/O sub-systems. By exploiting the inherent localities in the problem and making use of the MPI one-sided communication routines backed by RDMA operations available in the new parallel architectures, we show that it is possible to reduce the I/O overheads drastically for large problems. This is demonstrated in the subspace projection phase of J-scheme calculations on 6Li nucleus, where our new implementation based on one-sided MPI communications outperforms the previous I/O based implementation by almost a factor of 10.
What problem does this paper attempt to address?