Abstract:In this paper, we combine the positive aspects of the Gradient Sampling (GS) and bundle methods, as the most efficient methods in nonsmooth optimization, to develop a robust method for solving unconstrained nonsmooth convex optimization problems. The main aim of the proposed method is to take advantage of both GS and bundle methods, meanwhile avoiding their drawbacks. At each iteration of this method, to find an efficient descent direction, the GS technique is utilized for constructing a local polyhedral model for the objective function. If necessary, via an iterative improvement process, this initial polyhedral model is improved by some techniques inspired by the bundle and GS methods. The convergence of the method is studied, which reveals the following positive features (i) The convergence of our method is independent of the number of gradient evaluations required to establish and improve the initial polyhedral models. Thus, the presented method needs much fewer gradient evaluations in comparison to the original GS method. (ii) As opposed to GS type methods, the objective function need not be continuously differentiable on a full measure open set in $\mathbb R^n$ to ensure the convergence for the class of convex problems. Apart from the mentioned advantages, by means of numerical simulations, we show that the presented method provides promising results in comparison with GS methods, especially for large scale problems. Moreover, in contrast with bundle methods, our method is not very sensitive to the accuracy of supplied gradients.

A Proximal Bundle Method with Exact Penalty Technique and Bundle Modification Strategy for Nonconvex Nonsmooth Constrained Optimization

A Nonconvex Proximal Bundle Method for Nonsmooth Constrained Optimization

Proximal bundle methods for hybrid weakly convex composite optimization problems

A single cut proximal bundle method for stochastic convex composite optimization

A proximal bundle variant with optimal iteration-complexity for a large range of prox stepsizes

The Proximal Bundle Algorithm Under a Frank-Wolfe Perspective: an Improved Complexity Analysis

Primal-dual proximal bundle and conditional gradient methods for convex problems

A Cutting Plane and Level Stabilization Bundle Method with Inexact Data for Minimizing Nonsmooth Nonconvex Functions

Smoothed Proximal Lagrangian Method for Nonlinear Constrained Programs

Bundle-level type methods uniformly optimal for smooth and nonsmooth convex optimization

A Proximal-Gradient Method for Constrained Optimization

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Universal subgradient and proximal bundle methods for convex and strongly convex hybrid composite optimization

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Proximal Dogleg Opportunistic Majorization for Nonconvex and Nonsmooth Optimization

A Transformation-Proximal Bundle Algorithm for Multistage Adaptive Robust Optimization and Application to Constrained Robust Optimal Control

The Riemannian Convex Bundle Method

A new method based on the bundle idea and gradient sampling technique for minimizing nonsmooth convex functions

Bundle methods with quadratic cuts for deterministic and stochastic strongly convex optimization problems

Penalty Methods for a Class of Non-Lipschitz Optimization Problems

Parameter-free proximal bundle methods with adaptive stepsizes for hybrid convex composite optimization problems