Abstract:1 Introduction Typically, models of neural networks are divided into two categories in terms of signal transmission manner: feed-forward neural networks and recurrent neural networks. They are built up using different frameworks, which give rise to different fields of applications. Feed-forward neural network (FNN), also referred to as multilayer percep-trons (MLPs), has drawn great interests over the last two decades for its distinction as a universal function approximator As an important intelligent computation method, FNN has been applied to a wide range of applications, including curve fitting, pattern classification and nonlinear system identification and so on (Vemuri, 1995). FNN features a supervised training with a highly popular algorithm known as the error back-propagation algorithm. In the standard back-propagation (SBP) algorithm, the learning of a FNN is composed of two passes: in the forward pass, the input signal propagates through the network in a forward direction, on a layer-by-layer basis with the weights fixed; in the backward pass, the error signal is propagated in a backward manner. The weights are adjusted based on an error-correction rule. Although it has been successfully used in many real world applications, SBP suffers from two infamous shortcomings, i.e., slow learning speed and sensitivity to parameters. Many iterations are required to train small networks, even for a simple problem. The sensitivity to learning parameters, initial states and perturbations was analyzed in (Yeung and Sun, 2002). Behind such drawbacks the learning rate plays a key role in affecting the learning performance and it has to be chosen carefully. If the learning rate is large, the network may exhibit chaotic

New Neural Networks Based on Taylor Series and Their Research

Application study of a kind of novel neural networks models

QTFN: A General End-to-End Time-Frequency Network to Reveal the Time-Varying Signatures of the Time Series

Taylor Neural Network for Real-World Image Super-Resolution

Towards Robust DNNs: an Taylor Expansion-Based Method for Generating Powerful Adversarial Examples.

A New Neural Network Model And Its Application

Simo Fourier Neural Networks Research

Incorporating Taylor Series and Recursive Structure in Neural Networks for Time Series Prediction

Neural Networks: Computational Models and Applications - ReadingSample

Symplectic neural networks in Taylor series form for Hamiltonian systems

Quantized Tensor Neural Network

Stable Tensor Neural Networks for Rapid Deep Learning

An Efficient Approach to Regression Problems with Tensor Neural Networks

A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detection

Beyond Linearization: On Quadratic and Higher-Order Approximation of Wide Neural Networks

Network of Tensor Time Series

Power Series Expansion Neural Network

Neural Fourier Modelling: A Highly Compact Approach to Time-Series Analysis

A Fine-Grained Spectral Perspective on Neural Networks

Model Based and Physics Informed Deep Learning Neural Network Structures

Neural Taylor Approximations: Convergence and Exploration in Rectifier Networks