Abstract: In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed is critical for many emerging applications, most existing stochastic optimization methods suffer from slow convergence. Furthermore, the emerging technology of parallel computing has motivated an increasing demand for designing new stochastic optimization schemes that can handle parallel optimization for implementation in distributed systems. We propose a fast parallel stochastic optimization framework that can solve a large class of possibly non-convex stochastic optimization problems that may arise in applications with multi-agent systems. In the proposed method, each agent updates its control variable in parallel, by solving a convex quadratic subproblem independently. The convergence of the proposed method to the optimal solution for convex problems and to a stationary point for general non-convex problems is established. The proposed algorithm can be applied to solve a large class of optimization problems arising in important applications from various fields, such as machine learning and wireless networks. As a representative application of our proposed stochastic optimization framework, we focus on large-scale support vector machines and demonstrate how our algorithm can efficiently solve this problem, especially in modern applications with huge datasets. Using popular real-world datasets, we present experimental results to demonstrate the merits of our proposed framework by comparing its performance to the state-of-the-art in the literature. Numerical results show that the proposed method can significantly outperform the state-of-the-art methods in terms of the convergence speed while having the same or lower complexity and storage requirement.

A Simple Convergence Time Analysis of Drift-Plus-Penalty for Stochastic Optimization and Convex Programs

Parallel Stochastic Optimization Framework for Large-Scale Non-Convex Stochastic Problems

Convergence analysis of stochastic higher-order majorization-minimization algorithms

Extremely Fast Convergence Rates for Extremum Seeking Control with Polyak-Ruppert Averaging

Optimal Time Complexities of Parallel Stochastic Optimization Methods Under a Fixed Computation Model

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

An explicit analysis of the entropic penalty in linear programming

Stochastic Optimization with Constraints: A Non-asymptotic Instance-Dependent Analysis

Asymptotic Optimality in Stochastic Optimization

Convergence Rates Analysis of The Quadratic Penalty Method and Its Applications to Decentralized Distributed Optimization

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Stochastic Approximation of Smooth and Strongly Convex Functions: Beyond the O(1/T) Convergence Rate.

Stochastic Inertial Dynamics Via Time Scaling and Averaging

Linear Convergence of Stochastic Iterative Greedy Algorithms With Sparse Constraints

Stochastic-Constrained Stochastic Optimization with Markovian Data

Stochastic Primal-Dual Algorithms with Faster Convergence Than O(1/√T) for Problems Without Bilinear Structure

Queue Stability and Probability 1 Convergence via Lyapunov Optimization

Fast Stochastic Composite Minimization and an Accelerated Frank-Wolfe Algorithm under Parallelization

Convergence rates of stochastic gradient method with independent sequences of step-size and momentum weight

Maximizing Expected Utility for Stochastic Combinatorial Optimization Problems

A Gradient Smoothed Functional Algorithm with Truncated Cauchy Random Perturbations for Stochastic Optimization