Self-Learning Machines Based on Hamiltonian Echo Backpropagation

Víctor López-Pastor,Florian Marquardt,Víctor López-Pastor and Florian Marquardt
DOI: https://doi.org/10.1103/PhysRevX.13.031020
2023-08-19
Physical Review X
Abstract:A physical self-learning machine can be defined as a nonlinear dynamical system that can be trained on data (similar to artificial neural networks) but where the update of the internal degrees of freedom that serve as learnable parameters happens autonomously. In this way, neither external processing and feedback nor knowledge of (and control of) these internal degrees of freedom is required. We introduce a general scheme for self-learning in any time-reversible Hamiltonian system. It relies on implementing a time-reversal operation and injecting a small error signal on top of the echo dynamics. We show how the physical dynamics itself will then lead to the required gradient update of learnable parameters, independent of the details of the Hamiltonian. We illustrate the training of such a self-learning machine numerically for the case of coupled nonlinear wave fields and other examples. https://doi.org/10.1103/PhysRevX.13.031020 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Open access publication funded by the Max Planck Society. Published by the American Physical Society
physics, multidisciplinary
What problem does this paper attempt to address?