Dynamical system for computing largest generalized eigenvalue

Lijun Liu,Wei Wu

DOI: https://doi.org/10.1007/11759966_60

2006-01-01

Abstract:A dynamical system is proposed for generalized eigen- decomposition problem. The stable points of the dynamical system are proved to be the eigenvectors corresponding to the largest generalized eigenvalue.

What problem does this paper attempt to address?

Dynamical system for computing the eigenvectors associated with the largest eigenvalue of a positive definite matrix

Bingfu Zhang,Zheng Bao

DOI: https://doi.org/10.1109/72.377989

1995-01-01

Abstract:A dynamical system for computing the largest eigenpair of a given positive matrix is introduced. Certain qualitative properties of the proposed system are analyzed in detail. The authors' results suggest that the weight-bounding term in PCA algorithms for extracting the first principal component could assume a class of forms
Dynamic System for Solving Complex Eigenvalue Problems

Q Zhang,Yw Leung

DOI: https://doi.org/10.1049/ip-cta:19971123

1997-01-01

IEE Proceedings - Control Theory and Applications

Abstract:In the paper, the authors propose a dynamic system for solving complex eigenvalue problems. We show that, under some mild conditions, the set of the unit eigenvectors corresponding to the eigenvalue with the largest real part is asymptotically stable and the sets of the unit eigenvectors corresponding to the other eigenvalues is unstable. The proposed dynamical system can be realised as analogue neural networks for real-time applications.
A Prediction-Correction Dynamic Method for Large-Scale Generalized Eigenvalue Problems

Xin-long Luo,Jia-ru Lin,Wei-ling Wu

DOI: https://doi.org/10.1155/2013/845459

2013-01-01

Abstract and Applied Analysis

Abstract:This paper gives a new prediction-correction method based on the dynamical system of differential-algebraic equations for the smallest generalized eigenvalue problem. First, the smallest generalized eigenvalue problem is converted into an equivalent-constrained optimization problem. Second, according to the Karush-Kuhn-Tucker conditions of this special equality-constrained problem, a special continuous dynamical system of differential-algebraic equations is obtained. Third, based on the implicit Euler method and an analogous trust-region technique, a prediction-correction method is constructed to follow this system of differential-algebraic equations to compute its steady-state solution. Consequently, the smallest generalized eigenvalue of the original problem is obtained. The local superlinear convergence property for this new algorithm is also established. Finally, in comparison with other methods, some promising numerical experiments are presented.
Data-driven Method for Identifying the Expression of the Lyapunov Exponent from Random Data

Xi Chen,Xiaoling Jin,Zhilong Huang

DOI: https://doi.org/10.1016/j.ijnonlinmec.2022.104268

IF: 3.336

2022-01-01

International Journal of Non-Linear Mechanics

Abstract:A data-driven methodology is proposed to identify the expression of the largest Lyapunov exponent to determine the stochastic stability of the system. The method is carried out by two successive processes: one is to estimate the largest Lyapunov exponent from random discrete data, and the other is to identify the simplest expression of the largest Lyapunov exponent which includes system and excitation parameters. The first process is based on a new definition of the Lyapunov exponent of the disturbed states by using the ensemble average in a finite time. The data of the disturbed states are obtained from the differences between the random data of a few samples of system states. The second process resorts to the dimensional analysis method and the sparse optimization algorithm. Five typical examples, including linear stochastic dynamical system, Duffing oscillator, viscoelastic system, nonlinear system with two degrees of freedom subjected to Gaussian white noise, and Duffing oscillator subjected to uniformly distributed excitation, are given to illustrate the effectiveness of the proposed data-driven method and the extensionality of the identified expression of the largest Lyapunov exponent including system and excitation parameters. Moreover, it is concluded that the proposed data-driven method needs a smaller amount of data by comparing the traditional method for estimating the largest Lyapunov exponent from random data.
A Dynamical Method of Daes for the Smallest Eigenvalue Problem

Xin-long Luo

DOI: https://doi.org/10.1016/j.jocs.2012.01.002

IF: 3.817

2012-01-01

Journal of Computational Science

Abstract:This article gives a new method based on the dynamical system of differential-algebraic equations for the smallest eigenvalue problem of a symmetric matrix. First, the smallest eigenvalue problem is converted into an equivalent constrained optimization problem. Second, from the Karush–Kuhn–Tucker conditions for this special equality-constrained problem, a special continuous dynamical system of differential-algebraic equations is obtained. Lastly, based on the implicit Euler method and an analogous trust-region technique, we obtain a prediction-correction method to compute a steady-state solution of this special system of differential-algebraic equations, and consequently obtain the smallest eigenvalue of the original problem. We also analyze the local superlinear property for this new method, and present the promising numerical results, in comparison with other methods.
Letters: Recurrent neural network model for computing largest and smallest generalized eigenvalue

Lijun Liu,Hongmei Shao,Dong Nan

DOI: https://doi.org/10.1016/j.neucom.2008.05.005

IF: 6

2008-01-01

Neurocomputing

Abstract:A continuous recurrent neural network model is presented for computing the largest and smallest generalized eigenvalue of a symmetric positive pair (A,B). Convergence properties to the extremum eigenvalues based upon Liapunov functional with the help of the generalized eigen-decomposition theorem is obtained. Compared with other existing models, this model is also suitable for computing the smallest generalized eigenvalue simply by replacing A by -A as well as maintaining invariant norm property. Numerical simulation further shows the effectiveness of the proposed model.
A Decomposition Algorithm for the Sums of the Largest Eigenvalues

Ming Huang,Yue Lu,Jin Long Yuan,Yang Li

DOI: https://doi.org/10.1080/01630563.2020.1813758

2020-01-01

Numerical Functional Analysis and Optimization

Abstract:In this article, we consider optimization problems in which the sums of the largest eigenvalues of symmetric matrices are involved. Considered as functions of a symmetric matrix, the eigenvalues are not smooth once the multiplicity of the function is not single; this brings some difficulties to solve. For this, the function of the sums of the largest eigenvalues with affine matrix-valued mappings is handled through the application of the U-Lagrangian theory. Such theory extends the corresponding conclusions for the largest eigenvalue function in the literature. Inspired VU-space decomposition, the first- and second-order derivatives of U-Lagrangian in the space of decision variables R-m are proposed when some regular condition is satisfied. Under this condition, we can use the vectors of V-space to generate an implicit function, from which a smooth trajectory tangent to U can be defined. Moreover, an algorithm framework with superlinear convergence can be presented. Finally, we provide an application about arbitrary eigenvalue which is usually a class of DC functions to verify the validity of our approach.
Calculation of the Largest Lyapunov Exponent in the Discrete Dynamical System with Wavelet Analysis

HF Liu,YY Zhao,ZH Dai,X Gong,ZH Yu

DOI: https://doi.org/10.7498/aps.50.2311

IF: 0.906

2001-01-01

Acta Physica Sinica

Abstract:The largest Lyapunov exponent is an important parameter of detecting and characterizing chaos produced from a dynamical system. Based on simulative calculation, it has been found that the largest Lyapunov exponent of the small-scale wavelet transform modulus of a discrete dynamical system is the same as the system's. At the same time, the calculated results show that calculating the largest Lyapunov exponent with the small-scale wavelet transform modulus can efficiently eliminate the effect of strong large-scale noiss because of the high-pass filtering characteristic of small-scale wavelet transform.
Adaptive Algorithms for Generalized Eigenvalue Decomposition with A Nonquadratic Criterion

Wang Rong,Gao Feifei,Yao Minli,Zou Hongxing

DOI: https://doi.org/10.23919/cje.2013.10285835

IF: 1.019

2013-01-01

Chinese Journal of Electronics

Abstract:In this paper, we propose a nonquadratic criterion to solve the Generalized eigenvalue decomposition (GED) problem. This criterion exhibits a single global maximum that is attained if and only if the weight matrix spans the principal generalized subspace. The other stationary points of this criterion are (unstable) saddle points. Since the criterion is nonquadratic, it has a steep landscape and, therefore, yields fast gradient-based algorithms. Applying the projection approximation method and Recursive least squares (RLS) technique, we develop an adaptive algorithm with low computational complexity to track the principal generalized subspace, as well as an adaptive algorithm to parallely estimate the principal generalized eigen-vectors. Numerical results are provided to corroborate the proposed studies.
A Generalized Projective Dynamic for Solving Extreme and Interior Eigenvalue Problems

Lei-Hong Zhang,Li-Zhi Liao

DOI: https://doi.org/10.3934/dcdsb.2008.10.997

2008-01-01

Discrete and Continuous Dynamical Systems Series B

Abstract:In [18] (Golub and Liao), a continuous-time system which is based on the projective dynamic is proposed to solve some concave optimization problems (with the unit ball constraint) resulted from extreme and interior eigenvalue problems. The convergence inside the unit ball is established; however, neither further convergence result outside the unit ball nor the stability analysis is available. Moreover, preliminary numerical experience indicates that this method is sensitive to a parameter whose optimal value is still difficult to determine. After analyzing the stability of this dynamic, in this paper, we develop a generalized model and analyze the convergence of the new model both inside and outside the unit ball. The flow of the generalized model is proved to converge almost globally to some eigenvector corresponding to the smallest eigenvalue, and share many surprisingly analogous properties with the Rayleigh quotient gradient flow. Links of our generalized projective dynamical system with other related works are also discussed. The efficiency of our new model is both addressed in theory and verified in numerical testing.
A Practical Method to Compute the Largest Lyapunov Exponent

Miao Mingchuan,Wang Ruoqian,Yuan Shaoqiang,Fan Shangchun

DOI: https://doi.org/10.1117/12.717793

2006-01-01

Abstract:It is a significant problem to determine whether a dynamical system present chaos, it could be solved by measuring the largest Lyapunov exponent of the system. Lyapunov exponents quantify the exponential divergence of the close phase-space trajectories and offer quantities to estimate the chaos. This article proposes a new method to calculate the largest Lyapunov exponent from experimental data. The method makes use of mutual information method and Cao's method to reconstruct the phase-space, and gets the largest Lyapunov exponent by Sano-Sawada method from computing Lyapunov exponent spectrum. This article also shows how stable and robust this new method practices comparing with other methods proven by large numbers of test.
Dynamic Equations of Generalized Eigenvalue Problems

YL Jiang,RMM Chen

2002-01-01

IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences

Abstract:In this letter we present a new way for computing generalized eigenvalue problems in engineering applications. To transform a generalized eigenvalue problem into an associated problem for solving nonlinear dynamic equations by using optimization techniques., we can determine all eigenvalues and their eigenvectors for general complex matrices. Numerical examples are given to verify the formula of dynamic equations.
Online Dominant Generalized Eigenvectors Extraction Via a Randomized Algorithm

Haoyuan Cai,Maboud Kaloorazi,Jie Chen,Wei Chen,Cedric Richard

DOI: https://doi.org/10.1109/tvt.2023.3243244

IF: 6.8

2023-01-01

IEEE Transactions on Vehicular Technology

Abstract:This paper is concerned with online algorithms for the generalized Hermitian eigenvalue problem (GHEP). We first present an algorithm based on randomization, termed alternate-projections randomized eigenvalue decomposition (APR-EVD), to solve the standard eigenvalue problem. The APR-EVD algorithm is computationally efficient and can be computed by making only one pass through the input matrix. We then develop two online algorithms based on APR-EVD for the dominant generalized eigenvectors extraction. Our proposed algorithms use the fact that GHEP is transformed into a standard eigenvalue problem, however to avert computations of a matrix inverse and inverse of the square root of a matrix, which are prohibitive, they exploit the rank-1 strategy for the transformation. Our algorithms are devised for extracting generalized eigenvectors for scenarios in which observed stochastic signals have unknown covariance matrices. The effectiveness and practical applicability of our proposed algorithms are validated through numerical experiments with synthetic and real-world data.
Linear Convergence of an Algorithm for Computing the Largest Eigenvalue of a Nonnegative Tensor.

Liping Zhang,Liqun Qi

DOI: https://doi.org/10.1002/nla.822

2011-01-01

Numerical Linear Algebra with Applications

Abstract:SUMMARYAn iterative method for finding the largest eigenvalue of a nonnegative tensor was proposed by Ng, Qi, and Zhou in 2009. In this paper, we establish an explicit linear convergence rate of the Ng–Qi–Zhou method for essentially positive tensors. Numerical results are given to demonstrate linear convergence of the Ng–Qi–Zhou algorithm for essentially positive tensors. Copyright © 2011 John Wiley & Sons, Ltd.
The Largest Lyapunov Exponent of Chaotic Dynamical System in Scale Space and Its Application

HF Liu,YZ Yang,ZH Dai,ZH Yu

DOI: https://doi.org/10.1063/1.1596556

2003-01-01

Chaos An Interdisciplinary Journal of Nonlinear Science

Abstract:The largest Lyapunov exponent is an important invariant of detecting and characterizing chaos produced from a dynamical system. We have found analytically that the largest Lyapunov exponent of the small-scale wavelet transform modulus of a dynamical system is the same as the system’s largest Lyapunov exponent, both discrete map and continuous chaotic attractor with one or two positive Lyapunov exponents. This property has been used to estimate the largest Lyapunov exponent of chaotic time series with several kinds of strong additive noise.
Neural networks based approach for computing eigenvectors and eigenvalues of symmetric matrix

Zhang Yi,Yan Fu,Hua Jin Tang

DOI: https://doi.org/10.1016/S0898-1221(04)90110-1

IF: 3.218

2004-01-01

Computers & Mathematics with Applications

Abstract:Efficient computation of eigenvectors and eigenvalues of a matrix is an important problem in engineering, especially for computing eigenvectors corresponding to largest or smallest eigenvalues of a matrix. This paper proposes a neural network based approach to compute eigenvectors corresponding to the largest or smallest eigenvalues of any real symmetric matrix. The proposed network model is described by differential equations, which is a class of continuous time recurrent neural network model. It has parallel processing ability in an asynchronous manner and can achieve high computing performance. This paper provides a clear mathematical understanding of the network dynamic behaviors relating to the computation of eigenvectors and eigenvalues. Computer simulation results show the computational capability of the network model.
Algebraic Characteristics and Structure Decomposition for “Linear” Discrete Event Dynamic Systems

dazhong zheng,long wang

DOI: https://doi.org/10.1016/S1474-6670(17)51962-X

1990-01-01

IFAC Proceedings Volumes

Abstract:The problem on eigenvalue and eigenvector in maximum algebra, which play an important role in analyzing the periodical steady-state behavior, is discussed for a class of discrete event dynamic systems. Such discrete event dynamic systems can be viewed as linear systems in the sense of maximum algebra. A new algorithm, which is a closed-form and fast one, is given to find the eigenvalue of an irreducible system. The decomposition of system structure is presented when a discrete event dynamic system is not irreducible. For the case in which the system structure can not be known exactly, an efficient algorithm is given to estimate or to determine the eigenvalue and eigenvector by using a set of output data of a discrete event dynamic system. The results given in this paper can be used for performance evaluation and suggesting real time control rules for the flexible manufacturing systems.
Recurrent Neural Network for Computation of Generalized Eigenvalue Problem with Real Diagonalizable Matrix Pair and Its Applications.

Xuezhong Wang,Maolin Che,Yimin Wei

DOI: https://doi.org/10.1016/j.neucom.2016.07.042

IF: 6

2016-01-01

Neurocomputing

Abstract:We present neural networks to compute the left and right eigenvectors of the real diagonalizable matrix pair with real generalized eigenvalues, corresponding to the largest or the smallest generalized eigenvalue. We establish an explicit representation for the solutions of the neural network and analyze the convergence property. We consider how to use the above neural networks for computation of the singular value problem and the generalized singular value problem. In detail, we use our neural networks to compute the left and right singular vectors of a real matrix, corresponding to the largest or the smallest singular value. The right generalized singular vector of matrix pairs, corresponding to the largest or the smallest generalized singular value, can be computed by the neural networks. Numerical examples are given to illustrate our result is reasonable.
Parallel Multi-Time-Scale Decomposition Algorithm for Large-Scale Linear Systems

YG Xi,LP Chen,ZJ Zhang

DOI: https://doi.org/10.1016/s1474-6670(17)51614-6

1995-01-01

IFAC Proceedings Volumes

Abstract:In this paper the relation between the matrix equation approach and the eigenspace approach of multi-time-scale decomposition for large-scale linear systems is analysed. Based on the synthesis of these two approaches, a new iteration method based on dominant sub-eigenspace is presented and a parallel algorithm is derived. This new method has parallel characteristics and reserves the original structural property for some special systems.
Some Conditions on Stabilization of Generalized Dynamical Systems

Shuanghua Luo,Cheng-yi Zhang,Aiqun Huang

DOI: https://doi.org/10.1109/icmt.2011.6002543

2011-01-01

Abstract:Based on studying the distribution of generalized eigenvalues of some special matrix pairs, this paper propose some conditions for stabilization of generalized dynamical systems. An example is presented to demonstrate the results obtained in this paper.

Dynamical system for computing largest generalized eigenvalue

Dynamical system for computing the eigenvectors associated with the largest eigenvalue of a positive definite matrix

Dynamic System for Solving Complex Eigenvalue Problems

A Prediction-Correction Dynamic Method for Large-Scale Generalized Eigenvalue Problems

Data-driven Method for Identifying the Expression of the Lyapunov Exponent from Random Data

A Dynamical Method of Daes for the Smallest Eigenvalue Problem

Letters: Recurrent neural network model for computing largest and smallest generalized eigenvalue

A Decomposition Algorithm for the Sums of the Largest Eigenvalues

Calculation of the Largest Lyapunov Exponent in the Discrete Dynamical System with Wavelet Analysis

Adaptive Algorithms for Generalized Eigenvalue Decomposition with A Nonquadratic Criterion

A Generalized Projective Dynamic for Solving Extreme and Interior Eigenvalue Problems

A Practical Method to Compute the Largest Lyapunov Exponent

Dynamic Equations of Generalized Eigenvalue Problems

Online Dominant Generalized Eigenvectors Extraction Via a Randomized Algorithm

Linear Convergence of an Algorithm for Computing the Largest Eigenvalue of a Nonnegative Tensor.

The Largest Lyapunov Exponent of Chaotic Dynamical System in Scale Space and Its Application

Neural networks based approach for computing eigenvectors and eigenvalues of symmetric matrix

Algebraic Characteristics and Structure Decomposition for “Linear” Discrete Event Dynamic Systems

Recurrent Neural Network for Computation of Generalized Eigenvalue Problem with Real Diagonalizable Matrix Pair and Its Applications.

Parallel Multi-Time-Scale Decomposition Algorithm for Large-Scale Linear Systems

Some Conditions on Stabilization of Generalized Dynamical Systems