Aitken extrapolation method for computing the largest eigenvalue of nonnegative tensors

YinJun-Feng,KongXiao-He,ZhengNing

IF: 4.397

2015-01-01

Applied Mathematics and Computation

Abstract:Tensor eigenvalue problem recently attracts much research interest since it plays a very important role in both theoretical analysis of multilinear algebra and many practical applications. Numerica...

What problem does this paper attempt to address?

Aitken Extrapolation Method for Computing the Largest Eigenvalue of Nonnegative Tensors.

Jun-Feng Yin,Xiao-He Kong,Ning Zheng

DOI: https://doi.org/10.1016/j.amc.2015.01.059

IF: 4.397

2015-01-01

Applied Mathematics and Computation

Abstract:Tensor eigenvalue problem recently attracts much research interest since it plays a very important role in both theoretical analysis of multilinear algebra and many practical applications. Numerical iterative schemes were proposed to calculate the maximum eigenvalue of a non-negative tensor based on a Perron–Frobenius theorems. Using Aitken extrapolation technique, we propose a class of new iterative methods to calculate the largest eigenvalue of irreducible nonnegative tensors. The implementation of Aitken extrapolation is well studied. Numerical experiments show that the new methods are feasible and faster than original approaches.
Linear Convergence of an Algorithm for Computing the Largest Eigenvalue of a Nonnegative Tensor.

Liping Zhang,Liqun Qi

DOI: https://doi.org/10.1002/nla.822

2011-01-01

Numerical Linear Algebra with Applications

Abstract:SUMMARYAn iterative method for finding the largest eigenvalue of a nonnegative tensor was proposed by Ng, Qi, and Zhou in 2009. In this paper, we establish an explicit linear convergence rate of the Ng–Qi–Zhou method for essentially positive tensors. Numerical results are given to demonstrate linear convergence of the Ng–Qi–Zhou algorithm for essentially positive tensors. Copyright © 2011 John Wiley & Sons, Ltd.
The solution methods for the largest eigenvalue (singular value) of nonnegative tensors and convergence analysis

Zhongming Chen,Liqun Qi,Qingzhi Yang,Yuning Yang

DOI: https://doi.org/10.1016/j.laa.2013.09.027

IF: 1.307

2013-01-01

Linear Algebra and its Applications

Abstract:In this paper we study two solution methods for finding the largest eigenvalue (singular value) of general square (rectangular) nonnegative tensors. For a positive tensor, one can find the largest eigenvalue (singular value) based on the properties of the positive tensor and the power-type method. While for a general nonnegative tensor, we use a series of decreasing positive perturbations of the original tensor and repeatedly recall power-type method for finding the largest eigenvalue (singular value) of a positive tensor with an inexact strategy. We prove the convergence of the method for the general nonnegative tensor. Under a certain assumption, the computing complexity of the method is established. Motivated by the interior-point method for the convex optimization, we put forward a one-step inner iteration power-type method, whose convergence is also established under certain assumption. Additionally, by using embedding technique, we show the relationship between the singular values of the rectangular tensor and the eigenvalues of related square tensor, which suggests another way for finding the largest singular value of nonnegative rectangular tensor besides direct power-type method for this problem. Finally, numerical examples of our algorithms are reported, which demonstrate the convergence behaviors of our methods and show that the algorithms presented are promising.
An Inverse Extreme Eigenpair Problem and Its Parallel Iterative Solution for Symmetric Tridiagonal Matrices

ZY ZHANG

DOI: https://doi.org/10.1137/0732072

IF: 3.039

1995-01-01

SIAM Journal on Numerical Analysis

Abstract:This article concerns computing the largest (or smallest) eigenvalue and corresponding eigenvector of a large irreducible symmetric tridiagonal matrix. We divide the original extreme eigenpair problem into p subproblems when the matrix is partitioned in p-block form. An inverse extreme eigenpair problem associated with the divide method is considered: Find a (p - 1)-dimensional vector a such that the largest eigenvalue lambda of a given symmetric tridiagonal matrix T is the common largest eigenvalues of p small matrices T-i(a) which are updated matrices of the diagonal blocks T-i of T with rank-one/two corrections. We prove that the inverse problem is solvable and has a unique positive solution and that the corresponding eigenvector of T-i(a) with the positive solution a forms a section of the eigenvector of T corresponding to its largest eigenvalue. An algorithm is proposed for solving the inverse problem iteratively, on which a system of nonlinear equations should be solved for each of its iterative steps. It is proved that the iterative scheme converges for any positive initial vector and that its convergence is asymptotically quadratic. The new method can be used to compute the extreme eigenpairs of T and is well suited for parallel implementation. Some numerical tests were performed, which show the efficiency of the new parallelizable algorithm.
Computing the dominant eigenpair of an essentially nonnegative tensor via a homotopy method

Xingbang Cui,Liping Zhang

DOI: https://doi.org/10.1016/j.cam.2023.115565

IF: 2.872

2023-09-15

Journal of Computational and Applied Mathematics

Abstract:Computing the dominant eigenpair of an essentially nonnegative tensor is an important topic in tensor analysis and computation because of the important applications in network resource allocations. In this paper, we present an improved homotopy-type method inspired by [Chen et al ., A homotopy method for computing the largest eigenvalue of an irreducible nonnegative tensor. J. Comput. Appl. Math. 355 , 174-181 (2019)] to compute the dominant eigenpair of an essentially nonnegative tensor. Based on an approximation technique, the proposed algorithm is suitable for both irreducible and reducible cases and the global convergence analysis is established. Finally, we implement the method via a prediction–correction approach for path following and some numerical results are reported to illustrate the efficiency of the proposed algorithm.

mathematics, applied
Convergence analysis of the largest and smallest H-eigenvalues for a class of tensor sequences

Zhaofeng Lan,Jianxun Liu,Xianzhen Jiang

DOI: https://doi.org/10.1007/s12190-024-02096-2

2024-05-09

Journal of Applied Mathematics and Computing

Abstract:This paper considers the convergence analysis of the H-eigenvalues for a class of real symmetric and convergent tensor sequences. We first establish convergence results of some sequences of points. Then we study the behaviors of the H-eigenvalues and H-eigenvectors of the convergent tensor sequence. In particular, we obtain the convergence properties of the largest and smallest H-eigenvalues of the tensor sequence. Eventually, the corresponding numerical results are presented to verify our theoretical findings.

mathematics, applied
An Inexact Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

W. P. Shen,C. Li,X. Q. Jin

DOI: https://doi.org/10.1088/0266-5611/31/8/085007

IF: 2.408

2015-01-01

Inverse Problems

Abstract:We consider the convergence problem of an inexact Cayley transform method for solving inverse eigenvalue problems with multiple eigenvalues. Under the nonsingularity assumption of the relative generalized Jacobian matrix at the solution c * ?> , a convergence analysis covering both the distinct and multiple eigenvalues cases is provided and the superlinear convergence is proved. Moreover, numerical experiments are given in the last section and comparisons with the Cayley transform method are made.
Nonnegative Tensor Factorizations Using an Alternating Direction Method

Xingju Cai,Yannan Chen,Deren Han

DOI: https://doi.org/10.1007/s11464-012-0264-8

2013-01-01

Frontiers of Mathematics in China

Abstract:The nonnegative tensor (matrix) factorization finds more and more applications in various disciplines including machine learning, data mining, and blind source separation, etc. In computation, the optimization problem involved is solved by alternatively minimizing one factor while the others are fixed. To solve the subproblem efficiently, we first exploit a variable regularization term which makes the subproblem far from ill-condition. Second, an augmented Lagrangian alternating direction method is employed to solve this convex and well-conditioned regularized subproblem, and two accelerating skills are also implemented. Some preliminary numerical experiments are performed to show the improvements of the new method.
Krylov subspace methods for large multidimensional eigenvalue computation

Anas El Hachimi,Khalide Jbilou,Ahmed Ratnani

DOI: https://doi.org/10.1016/j.apnum.2024.01.017

IF: 2.994

2024-02-02

Applied Numerical Mathematics

Abstract:In this paper, we describe some Krylov subspace methods for computing eigentubes and eigenvectors (eigenslices) for large and sparse third-order tensors. This work provides projection methods for computing some of the largest (or smallest) eigentubes and eigenslices using the t-product. In particular, we use the tensor Arnoldi's approach for the non-hermitian case and the tensor Lanczos's approach for f-hermitian tensors. We also use the tensor block Arnoldi method to approximate the extreme eigentubes of a large tensor. Computed examples are given to illustrate the effectiveness of these methods.

mathematics, applied
An Algorithm to Find the Spectral Radius of Nonnegative Tensors and Its Convergence Analysis

Yuning Yang,Qingzhi Yang,Yanguang Li

DOI: https://doi.org/10.48550/arxiv.1102.2668

2011-01-01

Abstract:In this paper we propose an iterative algorithm to find out the spectral radius of nonnegative tensors. This algorithm is an extension of the smoothing method for finding the largest eigenvalue of a nonnegative matrix \cite{s14}. For nonnegative irreducible tensors, we establish the converges of the algorithm. Finally we report some numerical results and conclude this paper with some remarks.
A Decomposition Algorithm for the Sums of the Largest Eigenvalues

Ming Huang,Yue Lu,Jin Long Yuan,Yang Li

DOI: https://doi.org/10.1080/01630563.2020.1813758

2020-01-01

Numerical Functional Analysis and Optimization

Abstract:In this article, we consider optimization problems in which the sums of the largest eigenvalues of symmetric matrices are involved. Considered as functions of a symmetric matrix, the eigenvalues are not smooth once the multiplicity of the function is not single; this brings some difficulties to solve. For this, the function of the sums of the largest eigenvalues with affine matrix-valued mappings is handled through the application of the U-Lagrangian theory. Such theory extends the corresponding conclusions for the largest eigenvalue function in the literature. Inspired VU-space decomposition, the first- and second-order derivatives of U-Lagrangian in the space of decision variables R-m are proposed when some regular condition is satisfied. Under this condition, we can use the vectors of V-space to generate an implicit function, from which a smooth trajectory tangent to U can be defined. Moreover, an algorithm framework with superlinear convergence can be presented. Finally, we provide an application about arbitrary eigenvalue which is usually a class of DC functions to verify the validity of our approach.
An Inequality for the Perron Pair of an Irreducible and Symmetric Nonnegative Tensor with Application

Mao-Lin Che,Yi-Min Wei

DOI: https://doi.org/10.1007/s40305-016-0138-y

2016-01-01

Journal of the Operations Research Society of China

Abstract:The main purpose of this paper is to consider the Perron pair of an irreducible and symmetric nonnegative tensor and the smallest eigenvalue of an irreducible and symmetric nonsingular $\mathscr {M}$-tensor. We analyze the analytical property of an algebraic simple eigenvalue of symmetric tensors. We also derive an inequality about the Perron pair of nonnegative tensors based on plane stochastic tensors. We finally consider the perturbation of the smallest eigenvalue of nonsingular $\mathscr {M}$-tensors and design a strategy to compute its smallest eigenvalue. We verify our results via random numerical examples.
Truncated Power Method for Sparse Eigenvalue Problems

Xiao-Tong Yuan,Tong Zhang

DOI: https://doi.org/10.48550/arXiv.1112.2679

IF: 5.414

2011-12-12

Machine Learning

Abstract:This paper considers the sparse eigenvalue problem, which is to extract dominant (largest) sparse eigenvectors with at most $k$ non-zero components. We propose a simple yet effective solution called truncated power method that can approximately solve the underlying nonconvex optimization problem. A strong sparse recovery result is proved for the truncated power method, and this theory is our key motivation for developing the new algorithm. The proposed method is tested on applications such as sparse principal component analysis and the densest $k$-subgraph problem. Extensive experiments on several synthetic and real-world large scale datasets demonstrate the competitive empirical performance of our method.
Neural network approach to computing the eigenvectors corresponding to the largest and smallest eigenvalues of a positive matrix

Falong Lou,Yanda Li

1994-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:This paper presents a neural network approach to computing the eigenvectors corresponding to the largest and smallest eigenvalues of a positive matrix. This network is guaranteed to provide the results arbitrarily close to the accurate eigenvectors within an elapsed time of only a few characteristic time constants of the network.
A Refined Arnoldi Type Method for Large Scale Eigenvalue Problems

Xiang Wang,Qiang Niu,Lin-zhang Lu

DOI: https://doi.org/10.1007/s13160-012-0090-0

2012-01-01

Japan Journal of Industrial and Applied Mathematics

Abstract:We present a refined Arnoldi-type method for extracting partial eigenpairs of large matrices. The approximate eigenvalues are the Ritz values of (A−τ I)−1 with respect to a shifted Krylov subspace. The approximate eigenvectors are derived by satisfying certain optimal properties, and they can be computed cheaply by a small sized singular value problem. Theoretical analysis show that the approximate eigenpairs computed by the new method converges as the approximate subspace expands. Finally, numerical results are reported to show the efficiency of the new method.
Computing Eigenvectors of Normal Matrices with Simple Inverse Iteration

ZY Zhang,TW Ouyang

2003-01-01

Abstract:It is well-known that if we have an approximate eigenvalue (lambda) over cap of a normal matrix A of order n, a good approximation to the corresponding eigenvector u can be computed by one inverse iteration provided the position, say k(max), of the largest component of u is known. In this paper we give a detailed theoretical analysis to show relations between the eigenvector u and vector x(k), k = 1,..., n, obtained by simple inverse iteration, i.e., the solution to the system (A - (lambda) over capI)x = e(k) with e(k) the kth column of the identity matrix I. We prove that under some weak conditions, the index k(max) is of some optimal properties related to the smallest residual and smallest approximation error to u in spectral norm and Frobenius norm. We also prove that the normalized absolute vector v = \u\/parallel touparallel to(infinity) of u can be approximated by the normalized vector of (parallel tox(1)parallel to(2),..., parallel tox(n)parallel to(2))(T). We also give some upper bounds of \u(k)\ for those "optimal" indexes such as Fernando's heuristic for k(max) without any assumptions. A stable double orthogonal factorization method and a simpler but may less stable approach are proposed for locating the largest component of u.
Real-time Neural Computation of the Eigenvector Corresponding to the Largest Eigenvalue of Positive Matrix

L FALONG,L YANDA

DOI: https://doi.org/10.1016/0925-2312(93)e0055-i

IF: 6

1995-01-01

Neurocomputing

Abstract:This paper proposes a neural network approach to compute in real time the eigenvector corresponding to the largest eigenvalue of a positive matrix. We show analytically and by simulations that the proposed neural network is guaranteed to be stable and provides results arbitrarily close to the accurate eigenvector within an elapsed time of only a few characteristic time constants of the network. The parameters of the network such as interconnection strengths can be obtained from the given matrix without any computations. As a result, this proposed neural network is satisfactory for the real time application of signal processing in which it is desired to provide as fast as possible the eigenvector corresponding to the largest eigenvalue of a positive matrix,
An Interesting Method For The Exponentials For Some Special Matrices

jing chen,hongfen zou

DOI: https://doi.org/10.1080/21642583.2013.863168

2014-01-01

Systems Science & Control Engineering

Abstract:The matrix exponential e(At) plays a central role in linear system and control theory. This paper develops a method to compute the accurate solution for the matrix exponential e(At) with the assumption that the matrix A has an eigenvalue s(1) = 0. The examples show the effectiveness of the proposed method.
A parallel iterative method for solving symmetric tridiagonal extreme eigenpair problems

Zhenyue Zhang

DOI: https://doi.org/10.1016/0898-1221(93)90057-3

IF: 3.218

1993-01-01

Computers & Mathematics with Applications

Abstract:In this paper, we propose a parallel iterative method for calculating the extreme eigenpair (the largest or smallest eigenvalue and corresponding eigenvector) of a large symmetric tridiagonal matrix. It is based upon a divide and repeated, rank-one modification technique. The rank-one modification with a parameter only changes one diagonal element of each submatrix. We present a basic theory for subdividing the extremal eigenpair problem and then prove several convergence theorems that show the convergence of the iteration scheme for any positive initial modification parameter and the asymptotical quadratic convergence rate. Some numerical experiments are given, which show the efficiency of the parallel algorithm.
A Lanczos Method for Large-Scale Extreme Lorentz Eigenvalue Problems.

Lei-Hong Zhang,Chungen Shen,Wei Hong Yang,Joaquim João Júdice

DOI: https://doi.org/10.1137/17M1111401

IF: 1.908

2018-01-01

SIAM Journal on Matrix Analysis and Applications

Abstract:In this paper, we are concerned with an efficient algorithm for solving the extreme Lorentz eigenvalue problem (ELE). The Lorentz eigenvalue problem is an eigenvalue complementarity problem over the Lorentz cone, and solving ELE is equivalent to testing the Lorentz-copositivity for a given matrix. Treating ELE as a special eigenvalue problem, we propose a Lanczos-type method which mimics the Rayleigh-Ritz procedure and is suitable for large-scale and sparse problems. The numerical behavior and efficiency of the proposed method are supported by the theoretical convergence results and some preliminary numerical experiments.

Aitken extrapolation method for computing the largest eigenvalue of nonnegative tensors

Aitken Extrapolation Method for Computing the Largest Eigenvalue of Nonnegative Tensors.

Linear Convergence of an Algorithm for Computing the Largest Eigenvalue of a Nonnegative Tensor.

The solution methods for the largest eigenvalue (singular value) of nonnegative tensors and convergence analysis

An Inverse Extreme Eigenpair Problem and Its Parallel Iterative Solution for Symmetric Tridiagonal Matrices

Computing the dominant eigenpair of an essentially nonnegative tensor via a homotopy method

Convergence analysis of the largest and smallest H-eigenvalues for a class of tensor sequences

An Inexact Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

Nonnegative Tensor Factorizations Using an Alternating Direction Method

Krylov subspace methods for large multidimensional eigenvalue computation

An Algorithm to Find the Spectral Radius of Nonnegative Tensors and Its Convergence Analysis

A Decomposition Algorithm for the Sums of the Largest Eigenvalues

An Inequality for the Perron Pair of an Irreducible and Symmetric Nonnegative Tensor with Application

Truncated Power Method for Sparse Eigenvalue Problems

Neural network approach to computing the eigenvectors corresponding to the largest and smallest eigenvalues of a positive matrix

A Refined Arnoldi Type Method for Large Scale Eigenvalue Problems

Computing Eigenvectors of Normal Matrices with Simple Inverse Iteration

Real-time Neural Computation of the Eigenvector Corresponding to the Largest Eigenvalue of Positive Matrix

An Interesting Method For The Exponentials For Some Special Matrices

A parallel iterative method for solving symmetric tridiagonal extreme eigenpair problems

A Lanczos Method for Large-Scale Extreme Lorentz Eigenvalue Problems.