Abstract:When solving Hamiltonian systems using numerical integrators, preserving the symplectic structure may be crucial for many problems. At the same time, solving chaotic or stiff problems requires integrators to approximate the trajectories with extreme precision. So, integrating Hamilton's equations to a level of scientific reliability such that the answer can be used for scientific interpretation, may be computationally expensive. However, a neural network can be a viable alternative to numerical integrators, offering high-fidelity solutions orders of magnitudes faster.To understand whether it is also important to preserve the symplecticity when neural networks are used, we analyze three well-known neural network architectures that are including the symplectic structure inside the neural network's topology. Between these neural network architectures many similarities can be found. This allows us to formulate a new, generalized framework for these architectures. In the generalized framework Symplectic Recurrent Neural Networks, SympNets and HénonNets are included as special cases. Additionally, this new framework enables us to find novel neural network topologies by transitioning between the established ones.We compare new Generalized Hamiltonian Neural Networks (GHNNs) against the already established SympNets, HénonNets and physics-unaware multilayer perceptrons. This comparison is performed with data for a pendulum, a double pendulum and a gravitational 3-body problem. In order to achieve a fair comparison, the hyperparameters of the different neural networks are chosen such that the prediction speeds of all four architectures are the same during inference. A special focus lies on the capability of the neural networks to generalize outside the training data. The GHNNs outperform all other neural network architectures for the problems considered.

Integrating Port-Hamiltonian Systems with Neural Networks: From Deterministic to Stochastic Frameworks

Learning Subsystem Dynamics in Nonlinear Systems via Port-Hamiltonian Neural Networks

Nonlinear Stochastic Dynamics and Control in Hamiltonian Formulation

Neural Port-Hamiltonian Models for Nonlinear Distributed Control: An Unconstrained Parametrization Approach

Neural Distributed Controllers with Port-Hamiltonian Structures

Compositional Learning of Dynamical System Models Using Port-Hamiltonian Neural Networks

Learning Switching Port-Hamiltonian Systems with Uncertainty Quantification

Physics-informed neural networks via stochastic Hamiltonian dynamics learning

Hamiltonian-based neural networks for systems under nonholonomic constraints

Stochastic Systems: Modeling, Optimization, and Applications

Physics-guided and Energy-based Learning of Interconnected Systems: from Lagrangian to Port-Hamiltonian Systems.

Port-Hamiltonian Systems: Structure Recognition and Applications

Adaptable Hamiltonian neural networks

Data-driven Bayesian Control of Port-Hamiltonian Systems

Port-Hamiltonian Systems Theory: An Introductory Overview

A Generalized Framework of Neural Networks for Hamiltonian Systems

Towards a modeling class for port-Hamiltonian systems with time-delay

Well-posedness of Stochastic Port-Hamiltonian Systems on Infinite-dimensional Spaces

Stabilisation of stochastic single-file dynamics using port-Hamiltonian systems

A new perspective on dynamic network flow problems via port-Hamiltonian systems

Applications of Machine Learning to Modelling and Analysing Dynamical Systems