Abstract:Stochastic compositional minimax problems are prevalent in machine learning, yet there are only limited established on the convergence of this class of problems. In this paper, we propose a formal definition of the stochastic compositional minimax problem, which involves optimizing a minimax loss with a compositional structure either in primal , dual, or both primal and dual variables. We introduce a simple yet effective algorithm, stochastically Corrected stOchastic gradient Descent Ascent (CODA), which is a descent ascent type algorithm with compositional correction steps, and establish its convergence rate in aforementioned three settings. In the presence of the compositional structure in primal, the objective function typically becomes nonconvex in primal due to function composition. Thus, we consider the nonconvex-strongly-concave and nonconvex-concave settings and show that CODA can efficiently converge to a stationary point. In the case of composition on the dual, the objective function becomes nonconcave in the dual variable, and we demonstrate convergence in the strongly-convex-nonconcave and convex-nonconcave setting. In the case of composition on both variables, the primal and dual variables may lose convexity and concavity, respectively. Therefore, we anaylze the convergence in weakly-convex-weakly-concave setting. We also give a variance reduction version algorithm, CODA+, which achieves the best known rate on nonconvex-strongly-concave and nonconvex-concave compositional minimax problem. This work initiates the theoretical study of the stochastic compositional minimax problem on various settings and may inform modern machine learning scenarios such as domain adaptation or robust model-agnostic meta-learning.

Almost sure convergence of stochastic composite objective mirror descent for non-convex non-smooth optimization

Mirror descent method for stochastic multi-objective optimization

Variance-Reduced Proximal Stochastic Gradient Descent for Non-convex Composite optimization.

Adaptive Stochastic Optimisation of Nonconvex Composite Objectives

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Distributed Learning with Convex SUM-of -Non-convex Objective

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence

A Smoothing Stochastic Gradient Method for Composite Optimization

Almost Sure Convergence and Non-asymptotic Concentration Bounds for Stochastic Mirror Descent Algorithm

Stochastic smoothing accelerated gradient method for nonsmooth convex composite optimization

Can Decentralized Stochastic Minimax Optimization Algorithms Converge Linearly for Finite-Sum Nonconvex-Nonconcave Problems?

Stochastic subgradient for composite optimization with functional constraints

Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees

An optimal method for stochastic composite optimization

On the Local Convergence of a Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization

Stochastic Block Mirror Descent Methods for Nonsmooth and Stochastic Optimization

Robust Analysis of Almost Sure Convergence of Zeroth-Order Mirror Descent Algorithm

Almost Sure Convergence Rates Analysis and Saddle Avoidance of Stochastic Gradient Methods

Stochastic Mirror Descent for Convex Optimization with Consensus Constraints

On Almost Sure Convergence Rates of Stochastic Gradient Methods