Abstract:In the present paper, we formulate two versions of Frank--Wolfe algorithm or conditional gradient method to solve the DC optimization problem with an adaptive step size. The DC objective function consists of two components; the first is thought to be differentiable with a continuous Lipschitz gradient, while the second is only thought to be convex. The second version is based on the first and employs finite differences to approximate the gradient of the first component of the objective function. In contrast to past formulations that used the curvature/Lipschitz-type constant of the objective function, the step size computed does not require any constant associated with the components. For the first version, we established that the algorithm is well-defined of the algorithm and that every limit point of the generated sequence is a stationary point of the problem. We also introduce the class of weak-star-convex functions and show that, despite the fact that these functions are non-convex in general, the rate of convergence of the first version of the algorithm to minimize these functions is ${\cal O}(1/k)$. The finite difference used to approximate the gradient in the second version of the Frank-Wolfe algorithm is computed with the step-size adaptively updated using two previous iterations. Unlike previous applications of finite difference in the Frank-Wolfe algorithm, which provided approximate gradients with absolute error, the one used here provides us with a relative error, simplifying the algorithm analysis. In this case, we show that all limit points of the generated sequence for the second version of the Frank-Wolfe algorithm are stationary points for the problem under consideration, and we establish that the rate of convergence for the duality gap is ${\cal O}(1/\sqrt{k})$.

Reducing Discretization Error in the Frank-Wolfe Method

Using Taylor-Approximated Gradients to Improve the Frank-Wolfe Method for Empirical Risk Minimization

Frank-Wolfe Methods with an Unbounded Feasible Region and Applications to Structured Learning

Using Taylor-Approximated Gradients to Improve the Frank–Wolfe Method for Empirical Risk Minimization

Frank-Wolfe algorithm for DC optimization problem

Efficient K-Support-norm Regularized Minimization Via Fully Corrective Frank-Wolfe Method.

Fast Stochastic Composite Minimization and an Accelerated Frank-Wolfe Algorithm under Parallelization

Improved convergence rates for the multiobjective Frank-Wolfe method

Flexible block-iterative analysis for the Frank-Wolfe algorithm

The Frank-Wolfe algorithm: a short introduction

Minimization Over the Nonconvex Sparsity Constraint Using A Hybrid First-order method

Approximate Frank-Wolfe Algorithms over Graph-structured Support Sets.

Accelerated Affine-Invariant Convergence Rates of the Frank-Wolfe Algorithm with Open-Loop Step-Sizes

Large-scale nonconvex optimization: randomization, gap estimation, and numerical resolution

A Novel Frank-Wolfe Algorithm. Analysis and Applications to Large-Scale SVM Training

A nonsmooth Frank-Wolfe algorithm through a dual cutting-plane approach

Efficient shifted fractional trapezoidal rule for subdiffusion problems with nonsmooth solutions on uniform meshes

Fast Convergence of Frank-Wolfe algorithms on polytopes

Frank-Wolfe Methods in Probability Space

Explicit Local Time-Stepping for the Inhomogeneous Wave Equation with Optimal Convergence

Adaptive Variant of Frank-Wolfe Method for Relative Smooth Convex Optimization Problems