Abstract:<p>We propose new symplectic networks (SympNets) for identifying Hamiltonian systems from data based on a composition of linear, activation and gradient modules. In particular, we define two classes of SympNets: the LA-SympNets composed of linear and activation modules, and the G-SympNets composed of gradient modules. Correspondingly, we prove two new universal approximation theorems that demonstrate that SympNets can approximate arbitrary symplectic maps based on appropriate activation functions. We then perform several experiments including the pendulum, double pendulum and three-body problems to investigate the expressivity and the generalization ability of SympNets. The simulation results show that even very small size SympNets can generalize well, and are able to handle both separable and non-separable Hamiltonian systems with data points resulting from short or long time steps. In all the test cases, SympNets outperform the baseline models, and are much faster in training and prediction. We also develop an extended version of SympNets to learn the dynamics from irregularly sampled data. This extended version of SympNets can be thought of as a universal model representing the solution to an arbitrary Hamiltonian system.</p>

What problem does this paper attempt to address?

The core problem that this paper attempts to solve is: how to use neural networks to identify Hamiltonian systems from data and ensure that the constructed neural networks have a symplectic structure. Specifically, the author proposes a new type of SympNets, aiming to approximate any symplectic mapping through the combination of linear, activation and gradient modules, and verifies the expressive ability and generalization ability of these networks in multiple experiments. ### Main Problem Description 1. **Challenges in Identifying Hamiltonian Systems**: - Hamiltonian systems are an important class of dynamical systems in classical mechanics, and their phase flows have symplectic properties. Traditional numerical integration methods may destroy this symplectic structure during long - time simulations, resulting in the loss of physical properties such as energy conservation. - In order to make accurate long - term predictions, it is necessary to design a neural network model that can maintain the symplectic structure. 2. **Limitations of Existing Methods**: - Existing neural - network - based methods (such as Hamiltonian Neural Networks, HNNs) usually need to calculate the gradient of the Hamiltonian, which increases the complexity of training and prediction. - Most of these methods can only handle separable Hamiltonians, limiting their application range. 3. **Goals of the Paper**: - Propose a new SympNets architecture that can approximate any symplectic mapping without calculating the gradient of the Hamiltonian. - Verify the effectiveness and efficiency of the proposed SympNets when dealing with different types of Hamiltonian systems (including separable and non - separable systems). ### Solution Overview - **Design of SympNets**: - SympNets consists of linear modules, activation modules and gradient modules to ensure that the overall network maintains a symplectic structure. - The paper defines two types of SympNets: LA - SympNets (composed of linear and activation modules) and G - SympNets (composed of gradient modules). - **Theoretical Guarantees**: - The author proves that SympNets can approximate any symplectic mapping and gives two new universal approximation theorems, indicating that under appropriate activation functions, SympNets can approximate any symplectic mapping. - **Experimental Verification**: - Through multiple experiments such as pendulum, double pendulum and three - body problem, the expressive ability and generalization ability of SympNets are verified. - The experimental results show that even very small - scale SympNets can generalize well and are superior to baseline models (such as HNNs) in training and prediction speed. ### Summary This paper solves the difficult problem of maintaining the symplectic structure when identifying Hamiltonian systems from data by introducing SympNets, providing an efficient and flexible solution. This method is not only applicable to separable Hamiltonian systems, but also can handle non - separable cases and performs well in multiple practical problems.

SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems

Symplectic Neural Networks Based on Dynamical Systems

SympGNNs: Symplectic Graph Neural Networks for identifiying high-dimensional Hamiltonian systems and node classification

Deep Hamiltonian networks based on symplectic integrators

A Generalized Framework of Neural Networks for Hamiltonian Systems

CLPNets: Coupled Lie-Poisson Neural Networks for Multi-Part Hamiltonian Systems with Symmetries

Symplectic neural networks in Taylor series form for Hamiltonian systems

Symplectic Learning for Hamiltonian Neural Networks

Lie-Poisson Neural Networks (LPNets): Data-based computing of Hamiltonian systems with symmetries

Symplectic Structure-Aware Hamiltonian (Graph) Embeddings

Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Maps

Learning Generalized Hamiltonians using fully Symplectic Mappings

Sparse Symplectically Integrated Neural Networks

A time-dependent symplectic network for non-convex path planning problems with linear and nonlinear dynamics

Hamiltonian Matching for Symplectic Neural Integrators

Locally-symplectic neural networks for learning volume-preserving dynamics

Large-step neural network for learning the symplectic evolution from partitioned data

General Hamiltonian Neural Networks for Dynamic Modeling: Handling Sophisticated Constraints Automatically and Achieving Coordinates Free

Hamiltonian Neural Networks with Automatic Symmetry Detection