Abstract:Even though a variety of methods have been proposed in the literature, efficient and effective latent-space control (i.e., control in a learned low-dimensional space) of physical systems remains an open challenge. We argue that a promising avenue is to leverage powerful and well-understood closed-form strategies from control theory literature in combination with learned dynamics, such as potential-energy shaping. We identify three fundamental shortcomings in existing latent-space models that have so far prevented this powerful combination: (i) they lack the mathematical structure of a physical system, (ii) they do not inherently conserve the stability properties of the real systems, (iii) these methods do not have an invertible mapping between input and latent-space forcing. This work proposes a novel Coupled Oscillator Network (CON) model that simultaneously tackles all these issues. More specifically, (i) we show analytically that CON is a Lagrangian system - i.e., it possesses well-defined potential and kinetic energy terms. Then, (ii) we provide formal proof of global Input-to-State stability using Lyapunov arguments. Moving to the experimental side, we demonstrate that CON reaches SoA performance when learning complex nonlinear dynamics of mechanical systems directly from images. An additional methodological innovation contributing to achieving this third goal is an approximated closed-form solution for efficient integration of network dynamics, which eases efficient training. We tackle (iii) by approximating the forcing-to-input mapping with a decoder that is trained to reconstruct the input based on the encoded latent space force. Finally, we show how these properties enable latent-space control. We use an integral-saturated PID with potential force compensation and demonstrate high-quality performance on a soft robot using raw pixels as the only feedback information.

Oscillatory Neural Networks for Robotic Yo-Yo Control

Oscillator-Based Yoyo Control: Implementation And Comparison With Model-Based Control

Decentralized Heading Control with Rate Constraints using Pulse-Coupled Oscillators

Analysis of Neural Oscillator for Bio-inspired Robot Control

Application Analysis of Multiple Neurons Connected with Fast Inhibitory Synapses

Robotic yoyo playing with visual feedback

Oscillatory networks: Insights from piecewise-linear modeling

Modeling and Analyzing Biological Oscillations in Molecular Networks

Dual Control of Coupled Oscillator Networks

Nonlinear optimal control for robotic yoyo playing

Input-to-State Stable Coupled Oscillator Networks for Closed-form Model-based Control in Latent Space

Complex network control and stability through distributed critic‐based neuro‐fuzzy learning

Lyapunov-stable neural-network control

Learning Optimal Control of Synchronization in Networks of Coupled Oscillators using Genetic Programming-based Symbolic Regression

Chaotic Synchronization and Control in Nonlinear-Coupled Hindmarsh–Rose Neural Systems

Active Control of Multiple Neural Networks for Oscillating Combustion

Optimal Synchronization of Unidirectionally Coupled FO Chaotic Electromechanical Devices With the Hierarchical Neural Network

Neural network model to control an experimental chaotic pendulum

Nonlinear dynamics of a non-autonomous network with coupled discrete–continuum oscillators

Controlled Generation of Self-Sustained Oscillations in Complex Artificial Neural Networks

Coupled Perturbed Heteroclinic Cycles: Synchronization and Dynamical Behaviors of Spin-Torque Oscillators