Fast Algorithms for Displacement and Low-Rank Structured Matrices

Shivkumar Chandrasekaran,Nithin Govindarajan,Abhejit Rajagopal
DOI: https://doi.org/10.1145/3208976.3209025
2018-07-10
Abstract:This tutorial provides an introduction to the development of fast matrix algorithms based on the notions of displacement and various low-rank structures.
Numerical Analysis
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to develop fast matrix algorithms, especially for matrices with displacement structures and low - rank structures. Specifically, the authors hope to design more efficient algorithms by taking advantage of these special structures, thereby significantly reducing the computational complexity. ### Problem Background Traditionally, multiplying two \(n\times n\) general matrices or solving a system of linear equations with \(n\) unknowns requires approximately \(O(n^3)\) arithmetic operations (assuming that Strassen - style fast matrix multiplication is not used). However, for certain types of matrices, such as Toeplitz, Hankel, Vandermonde, Cauchy, etc., their special structures can be exploited to design faster algorithms. ### Core Problems of the Paper 1. **Displacement Structure**: By introducing the displacement operator \(L[A, B]\), defined as \(L[A, B](T)=T - ATB\), study how to use the displacement structure of matrix \(T\) to accelerate matrix operations. 2. **Low - Rank Structure**: Explore how to use the low - rank structure in matrices (for example, the low - rank characteristics of Hankel blocks) to design fast algorithms. This includes, but is not limited to: - Fast Gaussian elimination - Fast matrix - vector multiplication - Fast LU decomposition - Fast inversion ### Application Scenarios These fast algorithms have important applications in many fields, including but not limited to: - Signal processing - Numerical linear algebra - Solving integral equations - Fast Fourier Transform (FFT) ### Main Challenges Although some progress has been made, there are still some unresolved problems: - How to generalize these methods to more complex structures, such as Toeplitz - block - Toeplitz (TBT) matrices? - How to better understand the exact rank structure of the inverse matrices of discrete 2D and 3D Laplace - like matrices? ### Conclusion The paper provides a basic framework for fast algorithms for matrices with displacement structures and low - rank structures, and points out the directions for future research, especially the challenges in dealing with more complex matrix structures.