Abstract:In this paper, we consider a class of structured fractional programs, where the numerator part is the sum of a block-separable (possibly nonsmooth nonconvex) function and a locally Lipschitz differentiable (possibly nonconvex) function, while the denominator is a convex (possibly nonsmooth) function. We first present a novel reformulation for the original problem and show the relationship between optimal solutions, critical points and KL exponents of these two problems. Inspired by the reformulation, we propose a flexible framework of multi-proximity gradient algorithms (MPGA), which computes the proximity operator with respect to the Fenchel conjugate associated with the convex denominator of the original problem rather than evaluating its subgradient as in the existing methods. Also, MPGA employs a nonmonotone linear-search scheme in its gradient descent step, since the smooth part in the numerator of the original problem is not globally Lipschitz differentiable. Based on the framework of MPGA, we develop two specific algorithms, namely, cyclic MPGA and randomized MPGA, and establish their subsequential convergence under mild conditions. Moreover, the sequential convergence of cyclic MPGA with the monotone line-search (CMPGA_ML) is guaranteed if the extended objective associated with the reformulated problem satisfies the Kurdyka-Łojasiewicz (KL) property and some other mild assumptions. In particular, we prove that the corresponding KL exponents are 1/2 for several special cases of the fractional programs, and so, CMPGA_ML exhibits a linear convergence rate. Finally, some preliminary numerical experiments are performed to demonstrate the efficiency of our proposed algorithms.

Adaptive Fixed-Time Proximal Gradient Method for Non-Smooth Optimization: the Fractional Approach

Globally Optimal Solutions to a Class of Fractional Optimization Problems Based on Proximal Gradient Algorithm

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

A Bregman proximal subgradient algorithm for nonconvex and nonsmooth fractional optimization problems

A splitting primal-dual proximity algorithm for solving composite optimization problems

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

An equivalent reformulation and multi-proximity gradient algorithms for a class of nonsmooth fractional programming

The Novel Adaptive Fractional Order Gradient Decent Algorithms Design via Robust Control

An approximation proximal gradient algorithm for nonconvex-linear minimax problems with nonconvex nonsmooth terms

A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems

A Proximal-Gradient Method for Constrained Optimization

A Bregman Proximal Stochastic Gradient Method with Extrapolation for Nonconvex Nonsmooth Problems

Alternating and Parallel Proximal Gradient Methods for Nonsmooth, Nonconvex Minimax: A Unified Convergence Analysis

A nonmonotone accelerated proximal gradient method with variable stepsize strategy for nonsmooth and nonconvex minimization problems

Scaled Proximal Gradient Methods for Sparse Optimization Problems

Smoothing accelerated algorithm for constrained nonsmooth convex optimization problems

Accelerated Stochastic Algorithms for Nonconvex Finite-sum and Multi-block Optimization

A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization.

An Inexact Preconditioned Zeroth-order Proximal Method for Composite Optimization

Inexact Proximal Gradient Methods for Non-convex and Non-smooth Optimization

Fixed-Time Gradient Flows for Solving Constrained Optimization: A Unified Approach