Abstract:We focus on constrained, $L$-smooth, potentially stochastic and nonconvex-nonconcave min-max problems either satisfying $\rho$-cohypomonotonicity or admitting a solution to the $\rho$-weakly Minty Variational Inequality (MVI), where larger values of the parameter $\rho>0$ correspond to a greater degree of nonconvexity. These problem classes include examples in two player reinforcement learning, interaction dominant min-max problems, and certain synthetic test problems on which classical min-max algorithms fail. It has been conjectured that first-order methods can tolerate a value of $\rho$ no larger than $\frac{1}{L}$, but existing results in the literature have stagnated at the tighter requirement $\rho < \frac{1}{2L}$. With a simple argument, we obtain optimal or best-known complexity guarantees with cohypomonotonicity or weak MVI conditions for $\rho < \frac{1}{L}$. First main insight for the improvements in the convergence analyses is to harness the recently proposed $\textit{conic nonexpansiveness}$ property of operators. Second, we provide a refined analysis for inexact Halpern iteration that relaxes the required inexactness level to improve some state-of-the-art complexity results even for constrained stochastic convex-concave min-max problems. Third, we analyze a stochastic inexact Krasnosel'ski\uı-Mann iteration with a multilevel Monte Carlo estimator when the assumptions only hold with respect to a solution.

Max- and min-stability under first-order stochastic dominance

Minimal Quantile Functions Subject to Stochastic Dominance Constraints

Maxitive functions with respect to general orders

A Characterization of the n-th Degree Bounded Stochastic Dominance

Robust Stability Analysis for Autonomous Min-Max Systems.

Stabilizing control of robustness for systems with maximum uncertain parameters - A quadratic programming approach

A new characterization of second-order stochastic dominance

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

On Stabilization of Min-Max Systems.

Utility Maximization, Risk Aversion, and Stochastic Dominance

Revisiting Inexact Fixed-Point Iterations for Min-Max Problems: Stochasticity and Structured Nonconvexity

STABILITY OF THE EXPONENTIAL UTILITY MAXIMIZATION PROBLEM WITH RESPECT TO PREFERENCES

Stability and Generalization of Stochastic Gradient Methods for Minimax Problems

Maximum principle for discrete-time stochastic optimal control problem under distribution uncertainty

On quantitative stability in infinite-dimensional optimization under uncertainty

Quantitative Stability Estimate of the Hardy-Littlewood Functional Under Constraints

Minimax Optimal Estimation of Stability Under Distribution Shift

The reference interval in higher-order stochastic dominance

Stochastic maximum principle under probability distortion

Robust Robustness

Stochastic Maximum Principle for Subdiffusions and Its Applications