Ghost-OSD Method on Numerical Max-Plus Algebra

Yohei Oshida

2024-08-31

Abstract:In this paper, we introduce a method for reducing the calculation time of matrix exponentiation calculations on numerical max-plus algebra. In particular, we explain Ghost-OSD Method that can quickly calculate the powers of honest matrix. For more information on this abstract, see the PDF.

Numerical Analysis

What problem does this paper attempt to address?

Unbalanced Exponent Modular Reduction over Binary Field and Its Implementation

Haibin Shen,Yier Jin,Rongquan You

DOI: https://doi.org/10.1109/ICICIC.2006.180

2006-01-01

Abstract:Modular reduction is the basic operation of cryptographic systems. The Barrett's algorithm and Montgomery's algorithm are widely used nowadays and they are both based on pre-computation. In the field of elliptic curve cryptosystem (ECC) over GF(2m), the reduction polynomials recommended by SEC have few items and the degree of second item is much less than that of the first one. Making use of this characteristic, the paper presents a new method to accelerate modular reduction without pre-computation which speeds up modular reduction by 10-30 times over GF(2m) and speeds up ECC point multiplication by 40%-50%. This algorithm has been implemented in a high-speed public-key cipher accelerator
Off-Grid DOA Estimation Algorithm Based on Expanded Matrix and Matrix Pencil

Xuruoyang Jin,Haotian Chen,Chunyi Song,Zhiwei Xu,Guoyu Cui,Changyou Men,Quan Sun

DOI: https://doi.org/10.1109/vtc2024-spring62846.2024.10683422

2024-01-01

Abstract:The atomic norm minimization (ANM) is widely applied in the off-grid direction of arrival (DOA) estimation as a super-resolution method. However, the workload of ANM will become unbearable with the rapid growth of snapshots. At the same time, the follow-up work for existing ANM algorithms is quite cumbersome. Therefore, in this paper, we propose an improved off-grid DOA estimation algorithm based on expanded matrix and matrix pencil. The contribution is as follows: Firstly, the cross-covariance matrix (CCM) is expanded to simplify the operation of ANM while maintaining high resolution. Secondly, weighted matrix enhancement matrix pencil (WMEMP) is introduced by us. Computing efficiency is significantly improved by the structure of WMEMP. Optimal weight also improves resolution. The results show that our algorithm is suitable for L-shaped arrays, with good robustness, similar accuracy to the ANM algorithm, and higher computing efficiency compared with other off-grid estimation algorithms.
Accelerating Parallel Jacobi Method for Matrix Eigenvalue Computation in DOA Estimation Algorithm

Zhiguo Shi,Qianwen He,Ying Liu

DOI: https://doi.org/10.1109/tvt.2020.2984705

IF: 6.8

2020-01-01

IEEE Transactions on Vehicular Technology

Abstract:The calculation of eigenvalues of a matrix is required by many algorithms. Specifically, it is the key technique in subspace-based direction of arrival (DOA) estimation algorithms, e.g., multiple signal classification (MUSIC). The calculation of the eigenvalues therefore directly affects the real-time implementation of DOA estimation approaches. However, the classical Jacobi methods are time-consuming. In literature, a parallel implementation has been adopted to accelerate the calculation of eigenvalues. In this paper, we propose to further decrease the execution time of this parallel method. In particular, each parallel unit of the proposed method uses one coordinate rotation digital computer (CORDIC) period per iteration, while more are required by the traditional counterparts, such that the eigenvalue decomposition of the MUSIC algorithm can be accelerated. In addition, the proposed method is implemented in an FPGA platform. The experimental results show that the proposed method is more computationally efficient.
Efficient scaling and squaring method for the matrix exponential

Sergio Blanes,Nikita Kopylov,Muaz Seydaoğlu

2024-04-19

Abstract:This work presents a new algorithm to compute the matrix exponential within a given tolerance. Combined with the scaling and squaring procedure, the algorithm incorporates Taylor, partitioned and classical Padé methods shown to be superior in performance to the approximants used in state-of-the-art software. The algorithm computes matrix--matrix products and also matrix inverses, but it can be implemented to avoid the computation of inverses, making it convenient for some problems. If the matrix A belongs to a Lie algebra, then exp(A) belongs to its associated Lie group, being a property which is preserved by diagonal Padé approximants, and the algorithm has another option to use only these. Numerical experiments show the superior performance with respect to state-of-the-art implementations.

Numerical Analysis
Modified OSD Algorithm With Reduced Gaussian Elimination

Marc Fossorier,Mahdi Shakiba-Herfeh,Huazi Zhang

DOI: https://doi.org/10.1109/lcomm.2024.3416515

IF: 3.5529

2024-08-18

IEEE Communications Letters

Abstract:In this letter, the OSD algorithm is modified to perform a limited GE with complexity for an linear block code of rate .

telecommunications
Accelerated Multiple Precision Matrix Multiplication using Strassen's Algorithm and Winograd's Variant

Tomonori Kouya

DOI: https://doi.org/10.14495/jsiaml.6.81

2014-10-07

Abstract:The Strassen algorithm and Winograd's variant accelerate matrix multiplication by using fewer arithmetic operations than standard matrix multiplication. Although many papers have been published to accelerate single- as well as double-precision matrix multiplication by using these algorithms, no research to date has been undertaken to accelerate multiple precision matrix multiplication. In this paper, we propose a multiple precision matrix multiplication program for matrices of any size and test its performance. We also reveal special properties of our program through its application to LU decomposition.

Numerical Analysis
Algorithm for the CSR expansion of max-plus matrices using the characteristic polynomial

Yuki Nishida

2023-11-07

Abstract:Max-plus algebra is a semiring with addition $a\oplus b = \max(a,b)$ and multiplication $a\otimes b = a+b$. It is applied in cases, such as combinatorial optimization and discrete event systems. We consider the power of max-plus square matrices, which is equivalent to obtaining the all-pair maximum weight paths with a fixed length in the corresponding weighted digraph. Each $n$-by-$n$ matrix admits the CSR expansion that decomposes the matrix into a sum of at most $n$ periodic terms after $O(n^{2})$ times of powers. In this study, we propose an $O(n(m+n \log n))$ time algorithm for the CSR expansion, where $m$ is the number of nonzero entries in the matrix, which improves the $O(n^{4} \log n)$ algorithm known for this problem. Our algorithm is based on finding the roots of the characteristic polynomial of the max-plus matrix. These roots play a similar role to the eigenvalues of the matrix, and become the growth rates of the terms in the CSR expansion.

Optimization and Control
Acceleration of Approximate Matrix Multiplications on GPUs

Takuya Okuyama,André Röhm,Takatomo Mihana,Makoto Naruse

DOI: https://doi.org/10.3390/e25081130

2023-07-27

Abstract:Matrix multiplication is important in various information-processing applications, including the computation of eigenvalues and eigenvectors, and in combinatorial optimization algorithms. Therefore, reducing the computation time of matrix products is essential to speed up scientific and practical calculations. Several approaches have been proposed to speed up this process, including GPUs, fast matrix multiplication libraries, custom hardware, and efficient approximate matrix multiplication (AMM) algorithms. However, research to date has yet to focus on accelerating AMMs for general matrices on GPUs, despite the potential of GPUs to perform fast and accurate matrix product calculations. In this paper, we propose a method for improving Monte Carlo AMMs. We also give an analytical solution for the optimal values of the hyperparameters in the proposed method. The proposed method improves the approximation of the matrix product without increasing the computation time compared to the conventional AMMs. It is also designed to work well with parallel operations on GPUs and can be incorporated into various algorithms. Finally, the proposed method is applied to a power method used for eigenvalue computation. We demonstrate that, on an NVIDIA A100 GPU, the computation time can be halved compared to the conventional power method using cuBLAS.
Core-Sparse Monge Matrix Multiplication: Improved Algorithm and Applications

Paweł Gawrychowski,Egor Gorbachev,Tomasz Kociumaka

2024-08-09

Abstract:The task of min-plus matrix multiplication often arises in the context of distances in graphs and is known to be fine-grained equivalent to the All-Pairs Shortest Path problem. The non-crossing property of shortest paths in planar graphs gives rise to Monge matrices; the min-plus product of $n\times n$ Monge matrices can be computed in $O(n^2)$ time. Grid graphs arising in sequence alignment problems, such as longest common subsequence or longest increasing subsequence, are even more structured. Tiskin [SODA'10] modeled their behavior using simple unit-Monge matrices and showed that the min-plus product of such matrices can be computed in $O(n\log n)$ time. Russo [SPIRE'11] showed that the min-plus product of arbitrary Monge matrices can be computed in time $O((n+\delta)\log^3 n)$ parameterized by the core size $\delta$, which is $O(n)$ for unit-Monge matrices. In this work, we provide a linear bound on the core size of the product matrix in terms of the core sizes of the input matrices and show how to solve the core-sparse Monge matrix multiplication problem in $O((n+\delta)\log n)$ time, matching the result of Tiskin for simple unit-Monge matrices. Our algorithm also allows $O(\log \delta)$-time witness recovery for any given entry of the output matrix. As an application of this functionality, we show that an array of size $n$ can be preprocessed in $O(n\log^3 n)$ time so that the longest increasing subsequence of any sub-array can be reconstructed in $O(l)$ time, where $l$ is the length of the reported subsequence; in comparison, Karthik C. S. and Rahul [arXiv'24] recently achieved $O(l+n^{1/2}\log^3 n)$-time reporting after $O(n^{3/2}\log^3 n)$-time preprocessing. Our faster core-sparse Monge matrix multiplication also enabled reducing two logarithmic factors in the running times of the recent algorithms for edit distance with integer weights [Gorbachev & Kociumaka, arXiv'24].

Data Structures and Algorithms
Faster Matrix Multiplication Via Asymmetric Hashing

Ran Duan,Hongxun Wu,Renfei Zhou

DOI: https://doi.org/10.1109/focs57990.2023.00130

2023-01-01

Abstract:Fast matrix multiplication is one of the most fundamental problems in algorithm research. The exponent of the optimal time complexity of matrix multiplication is usually denoted by $\omega$. This paper discusses new ideas for improving the laser method for fast matrix multiplication. We observe that the analysis of higher powers of the Coppersmith-Winograd tensor [Coppersmith & Winograd 1990] incurs a “combination loss”, and we partially compensate for it using an asymmetric version of CW’s hashing method. By analyzing the eighth power of the CW tensor, we give a new bound of $\omega/\lt2.371866$, which improves the previous best bound of $\omega/\lt2.372860$ [Alman & Vassilevska Williams 2020]. Our result breaks the lower bound of 2.3725 in [Ambainis, Filmus & Le Gall 2015] because of the new method for analyzing component (constituent) tensors.
Faster Algorithms for Bounded-Difference Min-Plus Product

Shucheng Chi,Ran Duan,Tianle Xie

DOI: https://doi.org/10.1137/1.9781611977073.60

2022-01-01

Abstract:Min-plus product of two $n\times n$ matrices is a fundamental problem in algorithm research. It is known to be equivalent to APSP, and in general it has no truly subcubic algorithms. In this paper, we focus on the min-plus product on a special class of matrices, called $\delta$-bounded-difference matrices, in which the difference between any two adjacent entries is bounded by $\delta=O(1)$. Our algorithm runs in randomized time $O(n^{2.779})$ by the fast rectangular matrix multiplication algorithm [Le Gall \& Urrutia 18], better than $\tilde{O}(n^{2+\omega/3})=O(n^{2.791})$ ($\omega<2.373$ [Alman \& V.V.Williams 20]). This improves previous result of $\tilde{O}(n^{2.824})$ [Bringmann et al. 16]. When $\omega=2$ in the ideal case, our complexity is $\tilde{O}(n^{2+2/3})$, improving Bringmann et al.'s result of $\tilde{O}(n^{2.755})$.
High-Performance Computation of the Exponential of a Large Sparse Matrix

Feng Wu,Kailing Zhang,Li Zhu,Jiayao Hu

DOI: https://doi.org/10.1137/20M1342987

IF: 1.908

2021-12-08

SIAM Journal on Matrix Analysis and Applications

Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 42, Issue 4, Page 1636-1655, January 2021. Computation of the large sparse matrix exponential has been an important topic in many fields, such as network and finite-element analysis. The existing scaling and squaring algorithm (SSA) is not suitable for the computation of the large sparse matrix exponential as it requires more memory and has a higher computational cost than is actually needed. By introducing two novel concepts, i.e., real bandwidth and bandwidth, to measure the sparsity of the matrix, the sparsity of the matrix exponential is analyzed. It is found that for every matrix computed in the squaring phase of the SSA, a corresponding sparse approximate matrix exists. To obtain the sparse approximate matrix, a new filtering technique based on forward error analysis is proposed. Combining the filtering technique with the idea of keeping track of the incremental part, a competitive algorithm is developed for the large sparse matrix exponential. Due to the filtering technique, the proposed method can greatly alleviate the overscaling problem. Three sets of numerical experiments, including one large matrix with a dimension larger than , are conducted. The numerical experiments show that, compared with the expm function in MATLAB, the proposed algorithm can provide higher accuracy at lower computational cost and with less memory.

mathematics, applied
Computing the matrix fractional power with the double exponential formula

Fuminori Tatsuoka,Tomohiro Sogabe,Yuto Miyatake,Tomoya Kemmochi,Shao-Liang Zhang

DOI: https://doi.org/10.1553/etna_vol54s558

2021-04-10

Abstract:Two quadrature-based algorithms for computing the matrix fractional power $A^\alpha$ are presented in this paper. These algorithms are based on the double exponential (DE) formula, which is well-known for its effectiveness in computing improper integrals as well as in treating nearly arbitrary endpoint singularities. The DE formula transforms a given integral into another integral that is suited for the trapezoidal rule; in this process, the integral interval is transformed to the infinite interval. Therefore, it is necessary to truncate the infinite interval into an appropriate finite interval. In this paper, a truncation method, which is based on a truncation error analysis specialized to the computation of $A^\alpha$, is proposed. Then, two algorithms are presented -- one computes $A^\alpha$ with a fixed number of abscissas, and the other computes $A^\alpha$ adaptively. Subsequently, the convergence rate of the DE formula for Hermitian positive definite matrices is analyzed. The convergence rate analysis shows that the DE formula converges faster than the Gaussian quadrature when $A$ is ill-conditioned and $\alpha$ is a non-unit fraction. Numerical results show that our algorithms achieved the required accuracy and were faster than other algorithms in several situations.

Numerical Analysis
Computing exponentials of essentially non-negative matrices entrywise to high relative accuracy.

Jungong Xue,Qiang Ye

DOI: https://doi.org/10.1090/S0025-5718-2013-02677-4

IF: 2.118

2013-01-01

Mathematics of Computation

Abstract:A real square matrix is said to be essentially non-negative if all of its off-diagonal entries are non-negative. It has recently been shown that the exponential of an essentially non-negative matrix is determined entrywise to high relative accuracy by its entries up to a condition number intrinsic to the exponential function (Numer. Math. 110 (2008), 393-403). Thus the smaller entries of the exponential may be computed to the same relative accuracy as the bigger entries. This paper develops algorithms to compute exponentials of essentially non-negative matrices entrywise to high relative accuracy.
An explicit formula of powers of the $2\times 2$ quantum matrices and its applications

Genki Shibukawa

DOI: https://doi.org/10.48550/arXiv.2112.15464

2021-12-31

Abstract:We present an explicit formula of the powers for the $2\times 2$ quantum matrices, that is a natural quantum analogue of the powers of the usual $2\times 2$ matrices. As applications, we give some non-commutative relations of the entries of the powers for the $2\times 2$ quantum matrices, which is a simple proof of the results of Vokos-Zumino-Wess (1990).

Rings and Algebras
Low-synchronization Arnoldi Methods for the Matrix Exponential with Application to Exponential Integrators

Tanya Tafolla,Stéphane Gaudreault,Mayya Tokman

2024-10-19

Abstract:High order exponential integrators require computing linear combination of exponential like $\varphi$-functions of large matrices $A$ times a vector $v$. Krylov projection methods are the most general and remain an efficient choice for computing the matrix-function-vector-product evaluation when the matrix is $A$ is large and unable to be explicitly stored, or when obtaining information about the spectrum is expensive. The Krylov approximation relies on the Gram-Schmidt (GS) orthogonalization procedure to produce the orthonormal basis $V_m$. In parallel, GS orthogonalization requires \textit{global synchronizations} for inner products and vector normalization in the orthogonalization process. Reducing the amount of global synchronizations is of paramount importance for the efficiency of a numerical algorithm in a massively parallel setting. We improve the parallel strong scaling properties of exponential integrators by addressing the underlying bottleneck in the linear algebra using low-synchronization GS methods. The resulting orthogonalization algorithms have an accuracy comparable to modified Gram-Schmidt yet are better suited for distributed architecture, as only one global communication is required per orthogonalization-step. We present geophysics-based numerical experiments and standard examples routinely used to test stiff time integrators, which validate that reducing global communication leads to better parallel scalability and reduced time-to-solution for exponential integrators.

Numerical Analysis
Quantum power iteration to efficiently obtain the dominant eigenvector from diagonalizable nonnegative matrices

Brian C. Britt

DOI: https://doi.org/10.1007/s11128-024-04259-3

IF: 1.965

2024-01-28

Quantum Information Processing

Abstract:This manuscript presents a quantum computing implementation of power iteration for diagonalizable nonnegative matrices that offers a significant speed increase for large matrices, achieving time complexity for each iteration. The computational approach presented in this manuscript may be directly applied to numerous other algorithms derived from power iteration, ultimately allowing near-term quantum devices to facilitate a broad range of analyses that would otherwise be infeasible.

physics, multidisciplinary,quantum science & technology, mathematical
Matrix Kloosterman sums modulo prime powers

Márton Erdélyi,Árpád Tóth,Gergely Zábrádi

2024-01-25

Abstract:We give optimal bounds for matrix Kloosterman sums modulo prime powers extending earlier work of the first two authors on the case of prime moduli. These exponential sums arise in the theory of the horocyclic flow on $\mathrm{GL}_n$.

Number Theory

Ghost-OSD Method on Numerical Max-Plus Algebra

Unbalanced Exponent Modular Reduction over Binary Field and Its Implementation

Off-Grid DOA Estimation Algorithm Based on Expanded Matrix and Matrix Pencil

Accelerating Parallel Jacobi Method for Matrix Eigenvalue Computation in DOA Estimation Algorithm

Efficient scaling and squaring method for the matrix exponential

Modified OSD Algorithm With Reduced Gaussian Elimination

Accelerated Multiple Precision Matrix Multiplication using Strassen's Algorithm and Winograd's Variant

Algorithm for the CSR expansion of max-plus matrices using the characteristic polynomial

Acceleration of Approximate Matrix Multiplications on GPUs

Core-Sparse Monge Matrix Multiplication: Improved Algorithm and Applications

Faster Matrix Multiplication Via Asymmetric Hashing

Faster Algorithms for Bounded-Difference Min-Plus Product

High-Performance Computation of the Exponential of a Large Sparse Matrix

Computing the matrix fractional power with the double exponential formula

Computing exponentials of essentially non-negative matrices entrywise to high relative accuracy.

An explicit formula of powers of the $2\times 2$ quantum matrices and its applications

Low-synchronization Arnoldi Methods for the Matrix Exponential with Application to Exponential Integrators

Quantum power iteration to efficiently obtain the dominant eigenvector from diagonalizable nonnegative matrices

Matrix Kloosterman sums modulo prime powers