Abstract:Applications of neural network algorithms in rock physics have developed rapidly developed, mainly due to the neural network's powerful abilities in data modeling, signal processing, and image recognition. However, mathematical and physical explanations of neural networks remain limited, which makes it difficult to understand the behavior and mechanism of neural networks and limits their further development. Using mathematical and physical methods to explain the behavior of neural networks remains a challenging task. The goal of this study was to design a sound wave neural network (SWNN) structure based on sound wave partial differential equations and finite difference methods. The method transforms the first-order sound equations into the frequency domain and discretizes them using a central difference scheme. The differential formula takes the same form as the propagation function of a neural network, enabling the construction of a sound wave neural network. The main features of the SWNN are (1) a neural network with explicitly coupled pressure-velocity streams and inter-layer connections and (2) an adjoint variable method to improve the vanishing gradient problem in network training. The sound wave neural network established from the sound wave partial differential equation and finite difference algorithm has a solid mathematical modeling process and a clear physical explanation. This makes improving network performance within the framework of the mathematical and physical methods feasible. The numerical results showed that SWNN outperforms residual neural networks in image classification on CIFAR-10 and CIFAR-100 datasets. The partial differential equation neural network modeling method proposed in this paper can be applied to many other types of mathematical physics equations, providing a deep mathematical explanation for neural networks.

Long-Term Forecasting of Ocean Sound Speeds at Any Time Via Neural Ordinary Differential Equations

Unveiling the Spatial-Temporal Dynamics: Diffusion-based Learning of Conditional Distribution for Range-Dependent Ocean Sound Speed Field Forecasting

Research on Short-Term Prediction of Typical Trial Sea Environment in China Based on LSTM Neural Network

Rapid Modeling of the Sound Speed Field in the South China Sea Based on a Comprehensive Optimal LM-BP Artificial Neural Network

A Multi-Spatial Scale Ocean Sound Speed Prediction Method Based on Deep Learning

A Hybrid Wind Speed Prediction Approach Based on Ensemble Empirical Mode Decomposition and BO-LSTM Neural Networks for Digital Twin

Underwater Sound Speed Field Forecasting Based on the Least Square Support Vector Machine

Time-evolving Sound Speed Profile Tracking Using Ambient Noises in Shallow Water

Sound Velocity Profiles Time Series Prediction Method Based on EMD-NARX Model

Time series prediction of shallow water sound speed profile in the presence of internal solitary wave trains

Predictive Modeling of Future Full-Ocean Depth SSPs Utilizing Hierarchical Long Short-Term Memory Neural Networks

Sound wave neural network based on partial differential equation

Evaluation of Deep Neural Operator Models toward Ocean Forecasting

Deterministic wave prediction model for irregular long-crested waves with Recurrent Neural Network

Predicting ocean pressure field with a physics-informed neural network

OceanNet: A principled neural operator-based digital twin for regional oceans

Underwater sound speed inversion by joint artificial neural network and ray theory

NEURAL ORDINARY DIFFERENTIAL EQUATIONS FOR TIME SERIES RECONSTRUCTION

A Method for Sound Speed Profile Prediction Based on CNN-BiLSTM-Attention Network

Ocean reanalysis data‐driven deep learning forecast for sea surface multivariate in the South China Sea

Continual Learning of Range-Dependent Transmission Loss for Underwater Acoustic using Conditional Convolutional Neural Net