Abstract:Machine learning is a prominent and highly effective field of study, renowned for its ability to yield favorable outcomes in estimation and classification tasks. Within this domain, artificial neural networks (ANNs) have emerged as one of the most powerful methodologies. Physics-informed neural networks (PINNs) have proven particularly adept at solving physics problems formulated as differential equations, incorporating boundary and initial conditions into the ANN's loss function. However, a critical challenge in ANNs lies in determining the optimal architecture, encompassing the selection of the appropriate number of neurons and layers. Traditionally, the Single Multiplicative Neuron Model (SMNM) has been explored as a solution to this issue, utilizing a single neuron with a multiplication function in the hidden layer to enhance computational efficiency. This study initially aimed to apply the SMNM within the PINNs framework, targeting the differential equation y ' - y = 0 with boundary conditions y ( 0 ) = 1 and y ( 1 ) = e . Upon implementation, however, it was discovered that while the conventional SMNM approach was theorized to offer significant advantages, multiplicative aggregate function led to a failure in convergence. Consequently, we introduced a "mimic single multiplicative neuron model (mimic-SMNM)" employing an architecture with a single neuron, designed to simulate the SMNM's conceptual advantages while ensuring convergence and computational efficiency. Comparative analysis revealed that the real-PINNs accurately solved the equation, the true SMNM failed to converge, and the mimic model was highlighted for its architectural simplicity and computational feasibility, directly implying it is faster and more efficient than real PINNs for the solution of simple differential equations. Furthermore, our findings demonstrated that our proposed mimic-SMNM model achieves a five-times increase in computational speed compared to real PINNs after 30,000 epochs.

Models of Artificial Multi-Polynomial Higher Order Neural Networks

Group Models of Artificial Polynomial and Trigonometric Higher Order Neural Networks

Models of Artificial Higher Order Neural Networks

Data Simulations Using Cosine and Sigmoid Higher Order Neural Networks

Learning and Generalizing Polynomials in Simulation Metamodeling

Control Signal Generator Based on Ultra-High Frequency Polynomial and Trigonometric Higher Order Neural Networks

Financial Data Prediction by Artificial Sine and Cosine Trigonometric Higher Order Neural Networks

Data Classification Using Ultra-High Frequency SINC and Trigonometric Higher Order Neural Networks

SAS Nonlinear Models or Artificial Higher Order Neural Network Nonlinear Models?

Data Pattern Recognition Based on Ultra-High Frequency Sigmoid and Trigonometric Higher Order Neural Networks

Multi-fidelity Hierarchical Neural Processes

Time Series Data Analysis by Ultra-High Frequency Trigonometric Higher Order Neural Networks

Structured and Balanced Multi-component and Multi-layer Neural Networks

Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactions

Artificial Higher Order Neural Networks for Economics and Business

Evaluating single multiplicative neuron models in physics-informed neural networks for differential equations

A neural network based model for multi-dimensional nonlinear Hawkes processes

Nonlinear System Modeling Using Multiple Neural Networks

A neural network based model for multi-dimensional non-linear Hawkes processes

A Dendritic Neuron Model Optimized by Meta-Heuristics with a Power-Law-Distributed Population Interaction Network for Financial Time-Series Forecasting

Neural network as a simulation metamodel in economic analysis of risky projects