Abstract:Optimal control problems with nonsmooth objectives and nonlinear partial differential equation (PDE) constraints are challenging, mainly because of the underlying nonsmooth and nonconvex structures and the demanding computational cost for solving multiple high-dimensional and ill-conditioned systems after mesh-based discretization. To mitigate these challenges numerically, we propose an operator learning approach in combination with an effective primal-dual optimization idea which can decouple the treatment of the control and state variables so that each of the resulting iterations only requires solving two PDEs. Our main purpose is to construct neural surrogate models for the involved PDEs by operator learning, allowing the solution of a PDE to be obtained with only a forward pass of the neural network. The resulting algorithmic framework offers a hybrid approach that combines the flexibility and generalization of operator learning with the model-based nature and structure-friendly efficiency of primal-dual-based algorithms. The primal-dual-based operator learning approach offers numerical methods that are mesh-free, easy to implement, and adaptable to various optimal control problems with nonlinear PDEs. It is notable that the neural surrogate models can be reused across iterations and parameter settings, hence computational cost can be substantially alleviated. We validate the effectiveness and efficiency of the primal-dual-based operator learning approach across a range of typical optimal control problems with nonlinear PDEs, including optimal control of stationary Burgers equations, sparse bilinear control of parabolic equations, and optimal control of semilinear parabolic equations.

On a Primal-Dual Neural Network for Online

On the Simplified LVI-based Primal-Dual Neural Network for Solving LP and QP Problems

C2: Co-design of Robots Via Concurrent-Network Coupling Online and Offline Reinforcement Learning

C^2:Co-design of Robots via Concurrent Networks Coupling Online and Offline Reinforcement Learning

Towards Piecewise-Linear Primal Neural Networks For Optimization And Redundant Robotics

Inverse-free Dual Neural Networks for Online Solution of Strictly Convex Quadratic Programming.

On Dynamical System Modeling of Learned Primal-Dual with a Linear Operator $\mathcal{k}$: Stability and Convergence Properties

A set of nonlinear equations and inequalities arising in robotics and its online solution via a primal neural network.

A primal neural network for solving nonlinear equations and inequalities

A Practical Online Method for Distributionally Deep Robust Optimization

An Online Method for A Class of Distributionally Robust Optimization with Non-Convex Objectives

Online Primal-Dual for Non-linear Optimization with Applications to Speed Scaling

An Operator Learning Approach to Nonsmooth Optimal Control of Nonlinear PDEs

Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problems

A primal-dual perspective for distributed TD-learning

A Dual Neural Network Applied to Drift-Free Resolution of Five-Link Planar Robot Arm

Simulations And Experiments Of Znn For Online Quadratic Programming Applied To Manipulator Inverse Kinematics

On The Comparison Between Primal And Primal-Dual Methods In Decentralized Dynamic Optimization

A Dual Neural Network for Redundancy Resolution of Kinematically Redundant Manipulators Subject to Joint Limits and Joint Velocity Limits

A Simplified Lvi-Based Primal-Dual Neural Network For Repetitive Motion Planning Of Pa10 Robot Manipulator Starting From Different Initial States

Online Primal-Dual Methods with Measurement Feedback for Time-Varying Convex Optimization