Interpolative Butterfly Factorization

Yingzhou Li,Haizhao Yang
DOI: https://doi.org/10.1137/16M1074941
2016-11-17
Abstract:This paper introduces the interpolative butterfly factorization for nearly optimal implementation of several transforms in harmonic analysis, when their explicit formulas satisfy certain analytic properties and the matrix representations of these transforms satisfy a complementary low-rank property. A preliminary interpolative butterfly factorization is constructed based on interpolative low-rank approximations of the complementary low-rank matrix. A novel sweeping matrix compression technique further compresses the preliminary interpolative butterfly factorization via a sequence of structure-preserving low-rank approximations. The sweeping procedure propagates the low-rank property among neighboring matrix factors to compress dense submatrices in the preliminary butterfly factorization to obtain an optimal one in the butterfly scheme. For an $N\times N$ matrix, it takes $O(N\log N)$ operations and complexity to construct the factorization as a product of $O(\log N)$ sparse matrices, each with $O(N)$ nonzero entries. Hence, it can be applied rapidly in $O(N\log N)$ operations. Numerical results are provided to demonstrate the effectiveness of this algorithm.
Numerical Analysis
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to propose a new Interpolative Butterfly Factorization (IBF) method to achieve fast calculations of multiple transformations. Specifically, when the explicit formulas of these transformations satisfy certain analytical properties and their matrix representations conform to the complementary low - rank property, IBF can provide an approximately optimal implementation. ### Main problems and background 1. **Fast calculation of various transformations in large - scale scientific computing**: - These transformations are essentially matrix - vector multiplications \( u = Kg \), where the kernel matrix \( K \) is the discrete representation of the transformation and the vector \( g \) is the discrete representation of the function to be transformed. - The traditional Butterfly Algorithm has been proposed to handle this matrix - vector multiplication, but its construction process has a relatively high complexity, which are \( O(N^2) \) and \( O(N^{1.5}) \) respectively, and this may be too expensive in practical applications. 2. **Parallel scalability**: - In modern large - scale computing, the parallel scalability of fast algorithms is a key issue. Although there are already multiple fast algorithms (such as the non - uniform fast Fourier transform FFT), their parallel scalability in high - performance computing is still limited. ### Proposed solution The paper proposes the Interpolative Butterfly Factorization (IBF) method, aiming to solve the problems in the following ways: 1. **Reduce construction complexity**: - IBF can construct factorizations with an operation and memory complexity of \( O(N\log N) \), provided that the continuous kernel function \( K \) is explicitly available. - This method combines the Butterfly Algorithm and a novel structure - preserving matrix compression technique, thereby optimizing the sparse matrix representation and reducing pre - factors. 2. **Improve parallel scalability**: - The IBF framework allows for a highly parallelized implementation because its construction process mainly involves independent low - rank approximations, and the application process is a series of small - scale matrix - vector multiplications, which significantly reduces the communication overhead in parallel computing. 3. **Handle high - dimensional integral transformations**: - IBF is particularly suitable for quickly applying integral transformations of the form \[ u(x)=\int_{\mathbb{R}^d}a(x,\xi)e^{2\pi i\Phi(x,\xi)}g(\xi)d\xi \] where \( a(x,\xi) \) and \( \Phi(x,\xi) \) are the amplitude function and the phase function respectively, satisfying specific smoothness and homogeneity conditions. ### Summary By introducing the Interpolative Butterfly Factorization (IBF), this paper overcomes the deficiencies of the traditional Butterfly Algorithm in terms of construction complexity and parallel scalability, and provides an efficient, approximately optimal method to handle multiple transformations, especially having significant advantages in high - dimensional cases.