Abstract:<p>In this paper, we exploit the possibility of combining nonsmooth control jointly with projected gradient approaches to solve convex optimization problems with linear equality constraints. Our development gives rise to a sign projected gradient method employing only "coarse" information, which has finite-time convergence capability and preserves the simplicity and elegance of gradient descent. Our primary objective is to understand the design principle of the projection matrix in the nonsmooth setting and to investigate some key features of the method, such as convergence time. Specifically, we offer a set of convergence results via nonsmooth analysis, revealing that the algorithm guarantees finite-time convergence for a wide range of cost functions, including strongly convex, strictly convex, and convex functions, provided that the proposed design criteria and conditions are satisfied. The results suggest that the choice of the projection matrix might not be unique, which motivates the optimal design issue of the projection matrix to minimize convergence time. We show that the problem can be formulated as a convex optimization problem, which can be solved readily by existing optimization tools. We discuss the possibility of employing the proposed method to solve unconstrained optimization problems, which in turn gives an initial feasible solution to the sign projected gradient flow. We apply the algorithm to solve a formation control problem, and the numerical results show the effectiveness of the algorithm.</p>

Projected Gradient Iteration for Nonlinear Operator Equation

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

A Proximal Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems

Stable gradient projection method for nonlinear conditionally well-posed inverse problems

An Analysis of a Multi-Level Projected Steepest Descent Iteration for Nonlinear Inverse Problems in Banach Spaces Subject to Stability Constraints

Projected Gradient Descent Algorithms for Solving Nonlinear Inverse Problems with Generative Priors

Nonlinear Gradient Estimates for Elliptic Equations of General Type

Linear Convergence Results for Inertial Type Projection Algorithm for Quasi-Variational Inequalities

Efficient Projected Gradient Methods for L 0 Constrained Optimization

Easily implementable iterative methods for variational inequalities with nonlinear diffusion–convection operator and constraints to the gradient of solution

Sign projected gradient flow: A continuous-time approach to convex optimization with linear equality constraints

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

Nonlinear Gradient Estimates for Elliptic Equations in Quasiconvex Domains

Projection-type method with line-search process for solving variational inequalities

On the convergence of the gradient projection method for convex optimal control problems with bang–bang solutions

Variable p norm constrained LMS algorithm based on gradient of root relative deviation.pdf

Strong and linear convergence of projection-type method with an inertial term for finding minimum-norm solutions of pseudomonotone variational inequalities in Hilbert spaces

A Gradient Descent Based Algorithm for ℓ Minimization.

An inertia projection method for nonlinear pseudo-monotone equations with convex constraints

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations