Abstract:<p>In this paper, we exploit the possibility of combining nonsmooth control jointly with projected gradient approaches to solve convex optimization problems with linear equality constraints. Our development gives rise to a sign projected gradient method employing only "coarse" information, which has finite-time convergence capability and preserves the simplicity and elegance of gradient descent. Our primary objective is to understand the design principle of the projection matrix in the nonsmooth setting and to investigate some key features of the method, such as convergence time. Specifically, we offer a set of convergence results via nonsmooth analysis, revealing that the algorithm guarantees finite-time convergence for a wide range of cost functions, including strongly convex, strictly convex, and convex functions, provided that the proposed design criteria and conditions are satisfied. The results suggest that the choice of the projection matrix might not be unique, which motivates the optimal design issue of the projection matrix to minimize convergence time. We show that the problem can be formulated as a convex optimization problem, which can be solved readily by existing optimization tools. We discuss the possibility of employing the proposed method to solve unconstrained optimization problems, which in turn gives an initial feasible solution to the sign projected gradient flow. We apply the algorithm to solve a formation control problem, and the numerical results show the effectiveness of the algorithm.</p>

A General Quaternion-valued Gradient Operator and Its Applications to Computational Fluid Dynamics and Adaptive Beamforming

Transformations Between Aeromagnetic Gradients in Frequency Domain

Properties and Applications of a Restricted HR Gradient Operator

Quaternion Filtering Based on Quaternion Involutions and Its Application in Signal Processing

Quantitative study of 3D gradient operators

The HR-Calculus: Enabling Information Processing with Quaternion Algebra

Channel Equalization and Beamforming for Quaternion-Valued Wireless Communication Systems

Accelerated Gradient and Skew-Symmetric Splitting Methods for a Class of Monotone Operator Equations

Comments on "the Quaternion LMS Algorithm for Adaptive Filtering of Hypercomplex Processes".

Two novel numerical methods for gradient flows: generalizations of the Invariant Energy Quadratization method

Convex Quaternion Optimization for Signal Processing: Theory and Applications

QuACK: Accelerating Gradient-Based Quantum Optimization with Koopman Operator Learning

Sign projected gradient flow: A continuous-time approach to convex optimization with linear equality constraints

A General Algorithm for the Linear and Quadratic Gradients of Physical Quantities Based on 10 or More Point Measurements

Gradient Flows in Filtering and Fisher-Rao Geometry

Integral Theorems Based on a New Gradient Operator Derived from Biomembranes (part II): Applications

Quantum gradient descent algorithms for nonequilibrium steady states and linear algebraic systems

Application of Conjugate Gradient Algorithm to Adaptive Beamforming

Multilevel approximation of the gradient operator on an adaptive spherical geodesic grid