Mohamed Abou-Taleb,Maximilian Raff,Kathrin Flaßkamp,C. David Remy
Abstract:Trajectory optimization is a widely used tool in the design and control of dynamical systems. Typically, not only nonlinear dynamics, but also couplings of the initial and final condition through implicit boundary constraints render the optimization problem non-convex. This paper investigates how the Koopman operator framework can be utilized to solve trajectory optimization problems in a (partially) convex fashion. While the Koopman operator has already been successfully employed in model predictive control, the challenge of addressing mixed boundary constraints within the Koopman framework has remained an open question. We first address this issue by explaining why a complete convexification of the problem is not possible. Secondly, we propose a method where we transform the trajectory optimization problem into a bilevel problem in which we are then able to convexify the high-dimensional lower-level problem. This separation yields a low-dimensional upper-level problem, which could be exploited in global optimization algorithms. Lastly, we demonstrate the effectiveness of the method on two example systems: the mathematical pendulum and the compass-gait walker.
What problem does this paper attempt to address?
### What problem does this paper attempt to solve?
This paper aims to solve the trajectory optimization problem with mixed boundary conditions (MBCs). Specifically, the author studies how to use the Koopman operator framework to simplify and partially convexify these non - convex optimization problems, especially when dealing with nonlinear dynamics and mixed boundary conditions.
#### Main problem background:
1. **Complexity of trajectory optimization problems**:
- Trajectory optimization is widely used in the control and design of dynamic systems.
- Such problems usually contain nonlinear dynamics and initial and terminal conditions coupled by implicit boundary constraints, resulting in non - convex optimization problems.
- Non - convexity makes it very difficult to find the global optimal solution because numerical solvers are usually local in nature.
2. **Challenges in the application of Koopman operators**:
- Koopman operators have been successfully applied to model predictive control (MPC), but there are still open problems when dealing with mixed boundary conditions.
- It is impossible to fully convexify such problems, so methods of partial convexification need to be explored.
#### Core contributions of the paper:
1. **Proposing a bilevel optimization method**:
- The original problem is transformed into a bilevel optimization problem, including an upper - level problem and a lower - level problem.
- The lower - level problem can be convexified when the boundary and terminal time are fixed, similar to an MPC sub - problem.
- The upper - level problem optimizes the boundary values and terminal time. Although it is still non - convex, its dimension is significantly reduced.
2. **Handling mixed boundary conditions**:
- Three different methods are proposed to represent the boundary conditions in the lower - level problem: hard constraints, soft constraints, and partially hard constraints.
- Through these methods, it is ensured that the lifted state satisfies the original state constraints and stays as close as possible to the Koopman invariant manifold.
3. **Verifying the effectiveness of the method**:
- The effectiveness of the proposed method is verified through two examples of periodic trajectory optimization (mathematical pendulum and single - leg walking robot).
- The results show that in some cases, hard constraints perform better than soft constraints and can calculate the optimal state, input trajectory, and terminal time more accurately.
4. **Discussing limitations and future work**:
- The linear time - invariant approximation may not be able to fully capture the product terms of the state and input, which may be a problem in some cases.
- It is proposed to combine deep learning to jointly learn the Koopman generator and the observable function to reduce the prediction error and the number of lifting functions.
- The possibility of relaxing the convexity assumption of the cost function is explored, allowing nonlinear path constraints to be defined in the lifted space.
In conclusion, this paper is committed to simplifying and partially convexifying the trajectory optimization problem with mixed boundary conditions through the Koopman operator framework, thereby improving the solution efficiency and accuracy.