Abstract:In this paper, elliptic optimal control problems with L1-control cost and box constraints on the control are considered. To numerically solve the optimal control problems, we use the First optimize, then discretize approach. We focus on the inexact alternating direction method of multipliers (iADMM) and employ the standard piecewise linear finite element approach to discretize the subproblems in each iteration. However, in general, solving the subproblems is expensive, especially when the discretization is at a fine level. Motivated by the efficiency of the multigrid method for solving large-scale problems, we combine the multigrid strategy with the iADMM algorithm. Instead of fixing the mesh size before the computation process, we propose the strategy of gradually refining the grid. Moreover, to overcome the difficulty whereby the L1-norm does not have a decoupled form, we apply nodal quadrature formulas to approximately discretize the L1-norm and L2-norm. Based on these strategies, an efficient multilevel heterogeneous ADMM (mhADMM) algorithm is proposed. The total error of the mhADMM consists of two parts: the discretization error resulting from the finite-element discretization and the iteration error resulting from solving the discretized subproblems. Both errors can be regarded as the error of inexactly solving infinite-dimensional subproblems. Thus, the mhADMM can be regarded as the iADMM in function space. Furthermore, theoretical results on the global convergence, as well as the iteration complexity results o(1/k) for the mhADMM, are given. Numerical results show the efficiency of the mhADMM algorithm.

An ADMM Algorithm for a Generic $\ell_0$ Sparse Overlapping Group Lasso Problem

A Generalized Formulation for Group Selection via ADMM

An over-relaxed ADMM for separable convex programming and its applications to statistical learning

An efficient Hessian based algorithm for solving large-scale sparse group Lasso problems

An Empirical Study of ADMM for Nonconvex Problems

Square-Root Lasso with Nonconvex Regularization: an ADMM Approach

A proximal-gradient method for problems with overlapping group-sparse regularization: support identification complexity

Difference-of-Convex Algorithms for a Class of Sparse Group $\ell_0$ Regularized Optimization Problems

A fast ADMM algorithm for sparse precision matrix estimation using lasso penalized D-trace loss

Efficient sparse Hessian based algorithms for the clustered lasso problem.

A Riemannian ADMM

Alternating Direction Method of Multipliers Based on $\ell_{2,0}$-norm for Multiple Measurement Vector Problem

ADMM for Nonsmooth Composite Optimization under Orthogonality Constraints

A first-order optimization algorithm for statistical learning with hierarchical sparsity structure

A Dual Semismooth Newton Based Augmented Lagrangian Method for Large-Scale Linearly Constrained Sparse Group Square-Root Lasso Problems

A Multilevel Heterogeneous ADMM Algorithm for Elliptic Optimal Control Problems with L1-Control Cost

A Stochastic Alternating Direction Method of Multipliers for Non-smooth and Non-convex Optimization

A note on the group lasso and a sparse group lasso

A General Continuous-Time Formulation of Stochastic ADMM and Its Variants

Relaxing Alternating Direction Method of Multipliers (ADMM) for Linear Inverse Problems

A Unified Study on $L_1$ over $L_2$ Minimization