Abstract:The problem of stability analysis for the general class of random pulsed and switching neural networks is presented in this paper, which is to be investigated both continuous dynamics and impulsive jumps of random disturbances. Two numerical examples are used to explain and highlight the effectiveness of the results developed. The purpose of this article is to provide a comprehensive overview of studies, including continuous time and discrete time models for solving various problems, and their application in motion planning and superfluous manipulator management, chaotic system tracking, or even population control in mathematical biological sciences. Considering the fact that real-time performance is in demand for time-varying problems in practice, analysis of the stability and convergence of various models with continuous time is considered in a unified form in detail. In the case of solving the problems of discrete time, procedures are summarized for how to discriminate a continuous model and methods for obtaining an accuracy decision. Due to its strong ability to extract features and autonomous learning, neural networks are rooted in many industries, for example. neuroscience, mathematics, informatics and engineering, transport, etc. Despite their widespread use in various fields, such as artificial intelligence, language recognition, and computer simulation, the issue of neural network stability analysis is the most primary and fundamental that has attracted intense attention in recent decades. and references therein. It is well known that pulse and switching systems are formulated by combining pulse systems with switching systems, which is a more complex model of nonlinear systems. With their increasing use in network management, power systems, and the like, impulse control theory and switching systems have been a hot topic of research for the past decade. The fruitful results of research on stability analysis and control design of pulse and switching systems such as input stability, time-limited, controllability and observation and feedback control design, etc. On the other hand, it is also noteworthy. Keywords: Technical analysis of the neural network, electric transport, numerical algorithms, reliable stability

Analysis of Two Restart Algorithms.

Analyze and Design Network Architectures by Recursion Formulas

Restarting Algorithms: Sometimes there is Free Lunch

Accelerated Gradient Methods with Gradient Restart: Global Linear Convergence

A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation

Convergence Analysis for Restarted Anderson Mixing and Beyond

Convergence Analysis of Two-layer Neural Networks with ReLU Activation

Convergence Rates of Training Deep Neural Networks Via Alternating Minimization Methods.

INCREASING COMMUNICATION STABILITY IN ARTIFICIAL NEURAL NETWORKS

Choosing restart strategy at partial knowledge of process statistics

Accelerated gradient descent: A guaranteed bound for a heuristic restart strategy

Reverse Back Propagation to Make Full Use of Derivative

Restart of accelerated first order methods with linear convergence under a quadratic functional growth condition

Restart Strategy Selection using Machine Learning Techniques

A New Likelihood Ratio Method for Training Artificial Neural Networks

A proof of convergence for the gradient descent optimization method with random initializations in the training of neural networks with ReLU activation for piecewise linear target functions

A Generalized Neural Tangent Kernel Analysis for Two-layer Neural Networks

Why ReLU Units Sometimes Die: Analysis of Single-Unit Error Backpropagation in Neural Networks

Dynamic Learning Rate for Neural Networks: A Fixed-Time Stability Approach

Stabilizing RNN Gradients through Pre-training

Improving Steepest Descent Method by Learning Rate Annealing and Momentum in Neural Network