Abstract:The accelerated method in solving optimization problems has always been an absorbing topic. Based on the fixed-time (FxT) stability of nonlinear dynamical systems, we provide a unified approach for designing FxT gradient flows (FxTGFs). First, a general class of nonlinear functions in designing FxTGFs is provided. A unified method for designing first-order FxTGFs is shown under PolyakL jasiewicz inequality assumption, a weaker condition than strong convexity. When there exist both bounded and vanishing disturbances in the gradient flow, a specific class of nonsmooth robust FxTGFs with disturbance rejection is presented. Under the strict convexity assumption, Newton-based FxTGFs is given and further extended to solve time-varying optimization. Besides, the proposed FxTGFs are further used for solving equation-constrained optimization. Moreover, an FxT proximal gradient flow with a wide range of parameters is provided for solving nonsmooth composite optimization. To show the effectiveness of various FxTGFs, the static regret analysis for several typical FxTGFs are also provided in detail. Finally, the proposed FxTGFs are applied to solve two network problems, i.e., the network consensus problem and solving a system linear equations, respectively, from the respective of optimization. Particularly, by choosing component-wisely sign-preserving functions, these problems can be solved in a distributed way, which extends the existing results. The accelerated convergence and robustness of the proposed FxTGFs are validated in several numerical examples stemming from practical applications.

Dual Gradient Flow for Solving Linear Ill-Posed Problems in Banach Spaces

On a Complex Hessian Flow

Flow by Gauss Curvature to the $ L_p $ Dual Minkowski Problem

Flow by Gauss Curvature to the Aleksandrov and Dual Minkowski Problems

A gradient flow on control space with rough initial condition

A primal-dual flow for affine constrained convex optimization

Regularization properties of dual subgradient flow

A duality based approach to the minimizing total variation flow in the space $H^{-s}$

Minimizing Convex Functionals over Space of Probability Measures via KL Divergence Gradient Flow

The Convex Geometry of Backpropagation: Neural Network Gradient Flows Converge to Extreme Points of the Dual Convex Program

Fixed-Time Gradient Flows for Solving Constrained Optimization: A Unified Approach

A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spaces

Accelerated Gradient and Skew-Symmetric Splitting Methods for a Class of Monotone Operator Equations

Generalized Gradient Flows with Provable Fixed-Time Convergence and Fast Evasion of Non-Degenerate Saddle Points

Minimum Flow Steepest Descent Approach for Nonlinear PDE

Sign projected gradient flow: A continuous-time approach to convex optimization with linear equality constraints

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems

Discrete approximation of the minimizing movement scheme for evolution equations of Wasserstein gradient flow type with nonlinear mobility

A Dual Yamabe Flow and Related Integral Flows

A Fast Two-Point Gradient Algorithm Based on Sequential Subspace Optimization Method for Nonlinear Ill-Posed Problems

A Generalized Adaptive Levenberg–Marquardt Method for Solving Nonlinear Ill-Posed Problems