Output convergence analysis for delayed RNN with time varying inputs

Huajin Tang,Kaychen Tan,Zhang Yi

DOI: https://doi.org/10.1007/978-3-540-69226-3_16

2007-01-01

Abstract:null

What problem does this paper attempt to address?

Convergence analysis of discrete time RNNs for linear variational inequality problem

Huajin Tang,Kaychen Tan,Zhang Yi

DOI: https://doi.org/10.1007/978-3-540-69226-3_6

2007-01-01

Abstract:null
Convergence Analysis of General Neural Networks under Almost Periodic Stimuli

Zhenkun Huang,S. Mohamad,Xinghua Wang,Chunhua Feng

DOI: https://doi.org/10.1002/cta.490

IF: 2.378

2008-01-01

International Journal of Circuit Theory and Applications

Abstract:In this paper, we investigate the convergence dynamics of 2(N) almost periodic encoded patterns of general neural networks subjected to external almost periodic stimuli, including almost periodic delays. Invariant regions are established for the existence of 2(N) almost periodic encoded patterns under two classes of activation functions. By employing the property of M-cone and inequality technique, attracting basins are estimated and some criteria are derived for the networks to converge exponentially toward 2(N) almost periodic encoded patterns. The results obtained are new; they extend and generalize the corresponding results existing in the previous literature. Copyright (C) 2008 John Wiley & Sons, Ltd.
Stability analysis for neural dynamics with time-varying delays.

C Hou,J Qian

DOI: https://doi.org/10.1109/72.655044

1998-01-01

Abstract:By using the usual additive neural-network model, a delay-independent stability criterion for neural dynamics with perturbations of time-varying delays is derived. We extend previously known results obtained by Gopalsamy and He to the time varying delay case, and present decay estimates of solutions of neural networks. The asymptotic stability is global in the state space of neuronal activations. From the techniques used in this paper, it is shown that our criterion ensures stability of neural dynamics even when the delay functions vary violently with time. Our approach provides an effective method for the stability analysis of neural dynamics with delays.
Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Tang, H.J.,Tan, K.C.,Zhang, Y.

DOI: https://doi.org/10.1109/IJCNN.2002.1007530

2002-01-01

Abstract:We study the convergence of a class of discrete recurrent neural networks to solve linear variational inequality problem (LVIP). LVIP has important applications in engineering and economics. Not only the network's exponential convergence for the case of positive definite matrix is proved, but its global convergence for positive semidefinite matrix is also proved. Conditions are derived to guarantee the convergences of the network. Comprehensive examples are discussed and simulated to illustrate the results
Improved Delay-Dependent Stability Condition of Discrete Recurrent Neural Networks with Time-Varying Delays

Zhengguang Wu,Hongye Su,Jian Chu,Wuneng Zhou

DOI: https://doi.org/10.1109/tnn.2010.2042172

2010-01-01

IEEE Transactions on Neural Networks

Abstract:This brief investigates the problem of global exponential stability analysis for discrete recurrent neural networks with time-varying delays. In terms of linear matrix inequality (LMI) approach, a novel delay-dependent stability criterion is established for the considered recurrent neural networks via a new Lyapunov function. The obtained condition has less conservativeness and less number of variables than the existing ones. Numerical example is given to demonstrate the effectiveness of the proposed method.
Global Exponential Convergence Analysis of Delayed Neural Networks with Time-Varying Delays

Q Zhang,XP Wei,J Xu

DOI: https://doi.org/10.1016/j.physleta.2003.09.062

IF: 2.707

2003-01-01

Physics Letters A

Abstract:Some new sufficient conditions for the global exponential stability and estimations of bound on the rate of exponential convergence of the neural networks with time-varying delays are obtained by means of an approach based on delay differential inequality. The method, which does not make use of any Lyapunov functionals, is simple and valid for the stability analysis of neural networks with time-varying delays. Some previously established results in the literature are shown to be special cases of the presented results.
Effect of Constant External Input on Continuous Attractors Shifting

Jiali Yu,Huajin Tang

DOI: https://doi.org/10.1109/iciea.2012.6360789

2012-01-01

Abstract:The dynamics of a class of recurrent neural networks with uniform constant external input is investigated in this paper. Nowadays, continuous attractors have been recognized as promising model for describing the encoding of continuous stimuli in neural networks. The existence of the continuous attractors depends on a lot of factors such as connection weight and the external input and so on. The external input is very important in allowing the network to exhibit such an interesting character. Small changes in this external input level may shift a network from a relatively quiet state to some other state with highly complex dynamics. Thus, the external input may act as a switch that allows networks to be turned on or off regardless of their function. In this paper we find when the external input changes from zero to a small positive value, the steady state of network will shift from one continuous attractor to another. It shows how the external input controls the state of networks. Examples and simulation results are used to illustrate the theory.
An exponential-enhanced-type varying-parameter RNN for solving time-varying matrix inversion.

Zhijun Zhang,Lunan Zheng,Min Wang

DOI: https://doi.org/10.1016/j.neucom.2019.01.058

IF: 6

2019-01-01

Neurocomputing

Abstract:In order to compute time-varying matrix inversion faster, a novel exponential-enhanced-type varying-parameter recurrent neural network (EVP-RNN) is proposed and investigated in this paper. First, the detailed design process of the proposed EVP-RNN is stated and presented. Then, mathematical analysis proves that the proposed EVP-RNN has superior exponential convergence property than the conventional fixed-parameter recurrent neural network (FP-RNN) with four kinds of specific activation functions. Meanwhile, the guideline of choosing an activation function is provided to achieve a better convergence property. Third, theoretical analysis shows that the upper-bounds of calculation error of EVP-RNN are always smaller than those of FP-RNN and actual calculation error of EVP-RNN always converges faster than that of the FP-RNN. Simultaneously, an idea of designing a time-varying parameter is given. Finally, the results of comparative simulations verify the effectiveness, high accuracy, and superiority of the EVP-RNN compared with the traditional FP-RNN for solving time-varying matrix inversion.
Convergence Analysis of Asynchronous Stochastic Recursive Gradient Algorithms

Pengfei Wang,Nenggan Zheng

DOI: https://doi.org/10.1016/j.knosys.2022.109312

IF: 8.139

2022-01-01

Knowledge-Based Systems

Abstract:Asynchronous stochastic algorithms with variance reduction techniques have been empirically shown to be useful for many large-scale machine learning problems. By making a parallel optimization algorithm asynchronous, one can reduce the synchronization cost and improve the practical efficiency. Recently, the stochastic recursive gradient algorithm has shown superior theoretical performance; however, it is not scalable enough in the current big data era. To make it more practical, we propose a class of asynchronous stochastic recursive gradient methods and analyze them in the shared memory model. The analysis results show that our asynchronous algorithms can linearly converge to the solution in the strongly convex case and complete the iteration faster. In addition, we analyze the “price of asynchrony” and give the sufficient conditions required for linear speedup. To the best of our knowledge, our speedup conditions match the optimal bounds of asynchronous stochastic algorithms known thus far. Finally, we demonstrate our theoretical analyses from a practical implementation on a multicore machine.
Feedforward neural networks and training methods

Huajin Tang,Kaychen Tan,Zhang Yi

DOI: https://doi.org/10.1007/978-3-540-69226-3_2

2007-01-01

Abstract:null
New Stability Results of Discrete-Time Recurrent Neural Networks with Time-Varying Delays

Liyuan Hou,Hong Zhu,Shouming Zhong,Yong Zeng

DOI: https://doi.org/10.1109/iscid.2013.115

2013-01-01

Abstract:This paper addresses the problem of the stability of discrete-time recurrent neural networks (RNNs) with time-varying delays. By used some novel analysis techniques, stability theory and new Lyapunov-Krasovskii function, a linear matrix inequality (LMI) is developed to establish sufficient conditions for the RNNs to be globally asymptotically stable. Decomposing the delay interval approach is also employed in this paper, and the Lyapunov-Krasovskii functionals (LKFs) are constructed on these intervals, such that a new stability criterion is proposed in terms of Linear Matrix Inequalities (LMIs). A numerical example is given to demonstrate the effectiveness of the proposed method and the applicability of the proposed method.
Global Asymptotic Stability Analysis of Neural Networks with Time-Varying Delays

Zhang Qiang,Xiaopeng Wei,Jin Xu

DOI: https://doi.org/10.1007/s11063-004-3426-1

IF: 2.565

2005-01-01

Neural Processing Letters

Abstract:Global asymptotic stability of the equilibrium point of neural networks with time-varying delays is considered in this paper. By utilizing the Lyapunov--Razumikhin technique, some new sufficient conditions are given. The new criteria do not require the delay function to be differentiable and the activation functions to be bounded or monotone nondecreasing. The results presented here are less restrictive and conservative than those given in the earlier references. Two examples are discussed to compare the present results with the existing ones.
Output contraction analysis of nonlinear systems

Hao Yin,Bayu Jayawardhana,Stephan Trenn

2023-12-11

Abstract:This paper introduce the notion of output contraction that expands the contraction notion to the time-varying nonlinear systems with output. It pertains to the systems' property that any pair of outputs from the system converge to each other exponentially. This concept exhibits a more expansive nature when contrasted with another generalized contraction framework known as partial contraction. The first result establishes a connection between the output contraction of a time-varying system and the output exponential stability of its variational system. Subsequently, we derive a sufficient condition for achieving output contraction in time-varying systems by applying the output contraction Lyapunov criterion. Finally, we apply the results to analyze the output exponential stability of nonlinear time-invariant systems.

Systems and Control
On the Flexible Dynamics Analysis for the Unified Discrete-Time RNNs

Chen Qiao,Bao Guo

DOI: https://doi.org/10.1007/s11063-018-9959-5

IF: 2.565

2018-01-01

Neural Processing Letters

Abstract:The uniformly pseudo-projection-anti-monotone (UPPAM) networks can jointly cover almost all of the known recurrent neural network individuals. In this paper, we develop some convergence theory for the UPPAM networks when the time is discrete. The results for convergence to an equilibrium as well as to the ring whose period is not greater than 2 for the UPPAM networks do not require the connective weight matrices to be symmetric anymore, which is the basic requirements for many existing dynamics analysis for the discrete-time recurrent neural network models. In addition, these theorems contain the least constraints, give the general determinate methods of convergence for UPPAM networks, and can be verified and utilized very easily. The study shows that the approach adopted in the present paper is powerful, particularly in the sense of unifying, simplifying and extending the currently existing various dynamics results for discrete-time RNNs.
Exponential Stability of Recurrent Neural Networks with Time-Varying Discrete and Distributed Delays

Tao Li,Qi Luo,Changyin Sun,Baoyong Zhang

DOI: https://doi.org/10.1016/j.nonrwa.2008.03.004

IF: 2.765

2008-01-01

Nonlinear Analysis Real World Applications

Abstract:This paper is concerned with the problems of determining the global exponential stability and estimating the exponential-convergence rate for a class of recurrent neural networks (RNNs) with mixed discrete and distributed delays. By constructing an appropriate Lyapunov–Krasovskii functional and employing linear matrix inequality (LMI) technique, new delay-dependent exponential-stability criteria are derived in term of LMIs and the exponential-convergence rate is estimated. Numerical examples are given to show the effectiveness and improvement of the obtained results.
Convergence and Robustness Analysis of the Exponential-Type Varying Gain Recurrent Neural Network for Solving Matrix-Type Linear Time-Varying Equation

Zhijun Zhang,Zheng Fu,Lunan Zheng,Min Gan

DOI: https://doi.org/10.1109/access.2018.2873616

IF: 3.9

2018-01-01

IEEE Access

Abstract:To solve matrix-type linear time-varying equation more efficiently, a novel exponentialtype varying gain recurrent neural network (EVG-RNN) is proposed in this paper. Being distinguished from the traditional fixed-parameter gain recurrent neural network (FG-RNN), the proposed EVG-RNN is derived from a vectoror matrix-based unbounded error function by a varying-parameter neural dynamic approach. With four different kinds of activation functions, the super-exponential convergence performance of EVG-RNN is proved theoretically in details, of which the error convergence rate is much faster than that of FG-RNN. In addition, mathematics proves that the computation errors of EVG-RNN can converge to zero, and it possesses the capability of restraining external interference. Finally, series of computer simulations verify and illustrate the better performance of convergence and robustness of EVG-RNN than that of FG-RNN and FTZNN when solving the identical linear time-varying equation.
Stability Analysis of Delayed Neural Networks via a Time-Varying Lyapunov Functional

Huichao Lin,Jiuxiang Dong,Hong-Bing Zeng,Ju H. Park

DOI: https://doi.org/10.1109/tsmc.2023.3346060

2024-01-01

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Abstract:This article concerns the stability issues of neural networks with time-varying delays. The purpose is to establish less conservative stability conditions for delayed neural networks. In order to achieve this goal, a time-varying Lyapunov functional method is proposed for stability analysis of delayed neural networks. The main feature of this method is to construct different Lyapunov functionals in different time-varying delay subintervals, which relaxes the restriction requirement of traditional Lyapunov functionals constructing a common Lyapunov functional in the whole delay interval. Based on the developed time-varying Lyapunov functional, some new stability conditions for delayed neural networks are obtained. Finally, two examples are given to verify the effectiveness of the derived stability conditions.

automation & control systems,computer science, cybernetics
Input-to-state Practical Stability of Event-triggered Estimators for Discrete-time Recurrent Neural Networks With Unknown Time-delay

Yougang Wang,Yashuan Liu,Sanbo Ding

DOI: https://doi.org/10.1007/s12555-022-0598-2

2024-02-01

Abstract:In this paper, event-triggered estimators are designed for discrete-time recurrent neural networks (RNNs) with unknown time-delay. Owing to the diversity and complexity of time-delays, it is difficult to accurately predict their information. Under the boundedness of activation functions, the delay-depend term is regarded as a bounded nonlinear disturbance. Two event-triggered estimators are designed to estimate the neuron states. The first one considers the case that the system states are subject to unknown time-delay, and the second one deals with the case that both the system states and measurement outputs are subject to unknown time-delay. The sufficient conditions are developed to guarantee the input-to-state practical stability of estimation error systems. Finally, the dynamic event-triggered strategy is introduced to further reduce the events. Two numerical examples are given to show the validity of the developed scheme.

automation & control systems
Stability Analysis for Delayed Neural Networks via a Generalized Reciprocally Convex Inequality

Hui-Chao Lin,Hong-Bing Zeng,Xian-Ming Zhang,Wei Wang

DOI: https://doi.org/10.1109/tnnls.2022.3144032

IF: 14.255

2022-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:This article deals with the stability of neural networks (NNs) with time-varying delay. First, a generalized reciprocally convex inequality (RCI) is presented, providing a tight bound for reciprocally convex combinations. This inequality includes some existing ones as special case. Second, in order to cater for the use of the generalized RCI, a novel Lyapunov-Krasovskii functional (LKF) is constructed, which includes a generalized delay-product term. Third, based on the generalized RCI and the novel LKF, several stability criteria for the delayed NNs under study are put forward. Finally, two numerical examples are given to illustrate the effectiveness and advantages of the proposed stability criteria.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Lmi-Based Asymptotic Stability Analysis Of Neural Networks With Time-Varying Delays

Tao Li,Changyin Sun,Xianlin Zhao,Chong Lin

DOI: https://doi.org/10.1142/S0129065708001567

IF: 6.325

2008-01-01

International Journal of Neural Systems

Abstract:The problem of the global asymptotic stability for a class of neural networks with time-varying delays is investigated in this paper, where the activation functions are assumed to be neither monotonic, nor differentiable, nor bounded. By constructing suitable Lyapunov functionals and combining with linear matrix inequality (LMI) technique, new global asymptotic stability criteria about different types of time-varying delays are obtained. It is shown that the criteria can provide less conservative result than some existing ones. Numerical examples are given to demonstrate the applicability of the proposed approach.

Output convergence analysis for delayed RNN with time varying inputs

Convergence analysis of discrete time RNNs for linear variational inequality problem

Convergence Analysis of General Neural Networks under Almost Periodic Stimuli

Stability analysis for neural dynamics with time-varying delays.

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Improved Delay-Dependent Stability Condition of Discrete Recurrent Neural Networks with Time-Varying Delays

Global Exponential Convergence Analysis of Delayed Neural Networks with Time-Varying Delays

Effect of Constant External Input on Continuous Attractors Shifting

An exponential-enhanced-type varying-parameter RNN for solving time-varying matrix inversion.

Convergence Analysis of Asynchronous Stochastic Recursive Gradient Algorithms

Feedforward neural networks and training methods

New Stability Results of Discrete-Time Recurrent Neural Networks with Time-Varying Delays

Global Asymptotic Stability Analysis of Neural Networks with Time-Varying Delays

Output contraction analysis of nonlinear systems

On the Flexible Dynamics Analysis for the Unified Discrete-Time RNNs

Exponential Stability of Recurrent Neural Networks with Time-Varying Discrete and Distributed Delays

Convergence and Robustness Analysis of the Exponential-Type Varying Gain Recurrent Neural Network for Solving Matrix-Type Linear Time-Varying Equation

Stability Analysis of Delayed Neural Networks via a Time-Varying Lyapunov Functional

Input-to-state Practical Stability of Event-triggered Estimators for Discrete-time Recurrent Neural Networks With Unknown Time-delay

Stability Analysis for Delayed Neural Networks via a Generalized Reciprocally Convex Inequality

Lmi-Based Asymptotic Stability Analysis Of Neural Networks With Time-Varying Delays