Abstract:The control of legged robots, particularly humanoid and quadruped robots, presents significant challenges due to their high-dimensional and nonlinear dynamics. While linear systems can be effectively controlled using methods like Model Predictive Control (MPC), the control of nonlinear systems remains complex. One promising solution is the Koopman Operator, which approximates nonlinear dynamics with a linear model, enabling the use of proven linear control techniques. However, achieving accurate linearization through data-driven methods is difficult due to issues like approximation error, domain shifts, and the limitations of fixed linear state-space representations. These challenges restrict the scalability of Koopman-based approaches. This paper addresses these challenges by proposing a continual learning algorithm designed to iteratively refine Koopman dynamics for high-dimensional legged robots. The key idea is to progressively expand the dataset and latent space dimension, enabling the learned Koopman dynamics to converge towards accurate approximations of the true system dynamics. Theoretical analysis shows that the linear approximation error of our method converges monotonically. Experimental results demonstrate that our method achieves high control performance on robots like Unitree G1/H1/A1/Go2 and ANYmal D, across various terrains using simple linear MPC controllers. This work is the first to successfully apply linearized Koopman dynamics for locomotion control of high-dimensional legged robots, enabling a scalable model-based control solution.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve the challenges in the control of high - dimensional legged robots (especially humanoid and quadruped robots). Specifically, these robots have high - dimensional and nonlinear dynamic characteristics, which make their control complex and difficult. Although linear systems can be effectively controlled by methods such as model predictive control (MPC), the control of nonlinear systems is still very complicated. To solve this problem, the paper proposes a method based on the Koopman operator. The Koopman operator can approximate nonlinear dynamics as a linear model, thus allowing the use of proven linear control techniques. However, there are some challenges in achieving accurate linearization through data - driven methods, such as: - **Approximation error**: Due to the approximate nature of the Koopman operator, errors may be introduced. - **Domain shift**: Limited state - transition data only covers a subspace of the state space, causing the model to be prone to failure in the face of perturbations. - **Limitations of fixed linear state - space representation**: Traditional Koopman methods have difficulty dealing with high - dimensional systems. These problems limit the scalability and application range of the Koopman method. Therefore, this paper proposes a continuous learning algorithm, which aims to overcome these challenges by iteratively optimizing Koopman dynamics. Specific contributions include: 1. **Iterative continuous learning algorithm**: By gradually expanding the data set and the dimension of the latent space, this algorithm can effectively reduce the approximation error and domain shift, and ensure theoretical guarantees for error convergence. 2. **First successful application**: This is the first successful application of linearized Koopman dynamics to the motion control of high - dimensional legged robots. Efficient control is achieved using a simple MPC controller and has been verified on various terrains. In summary, this paper solves some key problems in the control of high - dimensional legged robots by improving the application of the Koopman operator, providing a scalable, model - based control solution.

Continual Learning and Lifting of Koopman Dynamics for Linear Control of Legged Robots

Learning Koopman Operators with Control Using Bi-level Optimization

Koopman Operators in Robot Learning

Learning Koopman Dynamics for Safe Legged Locomotion with Reinforcement Learning-based Controller

Deep Koopman Operator Based Model Predictive Control for Nonlinear Robotics Systems

Deep Koopman Operator With Control for Nonlinear Systems

Online Learning of Unknown Dynamics for Model-Based Controllers in Legged Locomotion

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

Centroidal State Estimation based on the Koopman Embedding for Dynamic Legged Locomotion

Derivative-Based Koopman Operators for Real-Time Control of Robotic Systems

Modeling and Control of Soft Robots Using the Koopman Operator and Model Predictive Control

Modeling, Reduction, and Control of a Helically Actuated Inertial Soft Robotic Arm via the Koopman Operator

High Dynamic Position Control for a Typical Hydraulic Quadruped Robot Leg Based on Virtual Decomposition Control

Control-Oriented Modeling of a Soft Manipulator Using the Learning-Based Koopman Operator

Physics-informed Deep Koopman Operator for Lagrangian Dynamic Systems

Data-driven optimal control of unknown nonlinear dynamical systems using the Koopman operator

Legged Robot Locomotion Via Hybrid Zero Dynamics and Model Predictive Control

Robust Position Control of a Continuum Manipulator Based on Selective Approach and Koopman Operator

Adaptive Koopman Embedding for Robust Control of Complex Nonlinear Dynamical Systems

Episodic Koopman Learning of Nonlinear Robot Dynamics with Application to Fast Multirotor Landing

Data-driven feedback stabilization of nonlinear systems: Koopman-based model predictive control