Linearly Recurrent Autoencoder Networks for Learning Dynamics

Samuel E. Otto,Clarence W. Rowley
DOI: https://doi.org/10.1137/18M1177846
2019-10-07
SIAM Journal on Applied Dynamical Systems
Abstract:SIAM Journal on Applied Dynamical Systems, Volume 18, Issue 1 , Page 558-593, January 2019. This paper describes a method for learning low-dimensional approximations of nonlinear dynamical systems, based on neural network approximations of the underlying Koopman operator. Extended Dynamic Mode Decomposition (EDMD) provides a useful data-driven approximation of the Koopman operator for analyzing dynamical systems. This paper addresses a fundamental problem associated with EDMD: a trade-off between representational capacity of the dictionary and overfitting due to insufficient data. A new neural network architecture combining an autoencoder with linear recurrent dynamics in the encoded state is used to learn a low-dimensional and highly informative Koopman-invariant subspace of observables. A method is also presented for balanced model reduction of overspecified EDMD systems in feature space. Nonlinear reconstruction using partially linear multikernel regression aims to improve reconstruction accuracy from the low-dimensional state when the data has complex but intrinsically low-dimensional structure. The techniques demonstrate the ability to identify Koopman eigenfunctions of the unforced Duffing equation, create accurate low-dimensional models of an unstable cylinder wake flow, and make short-time predictions of the chaotic Kuramoto--Sivashinsky equation.
mathematics, applied,physics, mathematical
What problem does this paper attempt to address?