Abstract:Extreme learning machine (ELM) is a type of randomized neural networks originally developed for linear classification and regression problems in the mid-2000s, and has recently been extended to computational partial differential equations (PDE). This method can yield highly accurate solutions to linear/nonlinear PDEs, but requires the last hidden layer of the neural network to be wide to achieve a high accuracy. If the last hidden layer is narrow, the accuracy of the existing ELM method will be poor, irrespective of the rest of the network configuration. In this paper we present a modified ELM method, termed HLConcELM (hidden-layer concatenated ELM), to overcome the above drawback of the conventional ELM method. The HLConcELM method can produce highly accurate solutions to linear/nonlinear PDEs when the last hidden layer of the network is narrow and when it is wide. The new method is based on a type of modified feedforward neural networks (FNN), termed HLConcFNN (hidden-layer concatenated FNN), which incorporates a logical concatenation of the hidden layers in the network and exposes all the hidden nodes to the output-layer nodes. HLConcFNNs have the interesting property that, given a network architecture, when additional hidden layers are appended to the network or when extra nodes are added to the existing hidden layers, the representation capacity of the HLConcFNN associated with the new architecture is guaranteed to be not smaller than that of the original network architecture. Here representation capacity refers to the set of all functions that can be exactly represented by the neural network of a given architecture. We present ample benchmark tests with linear/nonlinear PDEs to demonstrate the computational accuracy and performance of the HLConcELM method and the superiority of this method to the conventional ELM from previous works.

SLeNN-ELM: A shifted Legendre neural network method for fractional delay differential equations based on extreme learning machine

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Distributed Extreme Learning Machine for Nonlinear Learning over Network

A Chebyshev neural network-based numerical scheme to solve distributed-order fractional differential equations

Numerical Computation of Partial Differential Equations by Hidden-Layer Concatenated Extreme Learning Machine

A neural networks-based numerical method for the generalized Caputo-type fractional differential equations

Solving Partial Differential Equation Based on Bernstein Neural Network and Extreme Learning Machine Algorithm

Asymptotic stability of nonlinear fractional delay differential equations with α ∈ (1, 2): An application to fractional delay neural networks

Multilayered neural network for power series‐based approximation of fractional delay differential equations

A novel lagrange functional link neural network for solving variable-order fractional time-varying delay differential equations: a comparison with multilayer perceptron neural networks

Neural network method: delay and system of delay differential equations

A Nonoverlapping Domain Decomposition Method for Extreme Learning Machines: Elliptic Problems

Solving two-dimensional linear partial differential equations based on Chebyshev neural network with extreme learning machine algorithm

A new algorithm for solving nonlinear parabolic equations using extreme learning machine method with parameter retention

On Computing the Hyperparameter of Extreme Learning Machines: Algorithm and Application to Computational PDEs, and Comparison with Classical and High-Order Finite Elements

Efficient Solutions for Stochastic Fractional Differential Equations with a Neutral Delay Using Jacobi Poly-Fractonomials

Multiple Mittag-Leffler Stability of Almost Periodic Solutions for Fractional-Order Delayed Neural Networks: Distributed Optimization Approach

Numerical simulation for fractional delay differential equations

An effective numerical method for solving fractional delay differential equations using fractional-order Chelyshkov functions

Global Mittag-Leffler synchronization of discrete-time fractional-order neural networks with time delays

Delay-induced periodic oscillation for fractional-order neural networks with mixed delays