Abstract:We consider a general class of nonsmooth optimal control problems with partial differential equation (PDE) constraints, which are very challenging due to its nonsmooth objective functionals and the resulting high-dimensional and ill-conditioned systems after discretization. We focus on the application of a primal-dual method, with which different types of variables can be treated individually and thus its main computation at each iteration only requires solving two PDEs. Our target is to accelerate the primal-dual method with either larger step sizes or operator learning techniques. For the accelerated primal-dual method with larger step sizes, its convergence can be still proved rigorously while it numerically accelerates the original primal-dual method in a simple and universal way. For the operator learning acceleration, we construct deep neural network surrogate models for the involved PDEs. Once a neural operator is learned, solving a PDE requires only a forward pass of the neural network, and the computational cost is thus substantially reduced. The accelerated primal-dual method with operator learning is mesh-free, numerically efficient, and scalable to different types of PDEs. The acceleration effectiveness of these two techniques is promisingly validated by some preliminary numerical results.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper primarily proposes an improved primal-dual method for nonsmooth optimal control problems constrained by partial differential equations (PDEs). These types of problems are numerically challenging due to their nonsmooth objective functions, which, when discretized, result in high-dimensional and ill-conditioned systems. The focus of the paper is on accelerating the primal-dual method through the following two approaches: 1. **Increasing Step Size**: Enhancing the numerical performance of the primal-dual method by appropriately increasing the step size parameter. 2. **Operator Learning Acceleration**: Utilizing deep neural networks to construct surrogate models for PDEs, thereby significantly reducing the computational cost required to solve the PDEs. Specifically: - **Method of Increasing Step Size**: By adjusting the step size parameter in the primal-dual method, the efficiency of the algorithm can be significantly improved while ensuring convergence. - **Method of Operator Learning**: By training neural networks to approximate the solution operator of the PDE, each PDE solution requires only a single forward propagation, greatly reducing computational costs. This method not only avoids the need for mesh processing but is also applicable to different types of PDE problems. ### Main Contributions - Proposed an acceleration strategy based on the primal-dual method, improving algorithm efficiency by increasing the step size or using operator learning techniques. - Theoretically proved the convergence of the primal-dual method under increased step size conditions and demonstrated how deep neural networks can be used to accelerate the solution process. - Verified the effectiveness of these two acceleration techniques through preliminary numerical experiments.

Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problems

An Operator Learning Approach to Nonsmooth Optimal Control of Nonlinear PDEs

Sequential Linear Quadratic Control of Bilinear Parabolic PDEs Based on POD Model Reduction

Chemical Process Optimization Approach Based on Primal-Dual Interior-Point Method

Accelerated Optimization in Deep Learning with a Proportional-Integral-derivative Controller

Accelerated Primal-Dual Projection Neurodynamic Approach With Time Scaling for Linear and Set Constrained Convex Optimization Problems

Acceleration of Primal–Dual Methods by Preconditioning and Simple Subproblem Procedures

A Natural Primal-Dual Hybrid Gradient Method for Adversarial Neural Network Training on Solving Partial Differential Equations

Intelligent acceleration adaptive control of linear $2\times2$ hyperbolic PDE systems

Auto-conditioned primal-dual hybrid gradient method and alternating direction method of multipliers

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems

Intelligent Acceleration Adaptive Control of Linear 2×2 Hyperbolic PDE Systems

A fast primal-dual algorithm via dynamical system with variable mass for linearly constrained convex optimization

Accelerated nonlinear primal-dual hybrid gradient methods with applications to supervised machine learning

A nonsmooth primal-dual method with interwoven PDE constraint solver

Accelerated Primal-Dual Mirror Dynamics for Centralized and Distributed Constrained Convex Optimization Problems

Accelerated Primal-dual Scheme for a Class of Stochastic Nonconvex-concave Saddle Point Problems

Parallel Primal-Dual Active-Set Algorithm with Nonlinear and Linear Preconditioners

A primal--dual algorithm as applied to optimal control problems

A Universal Accelerated Primal–Dual Method for Convex Optimization Problems