Abstract:The minimization of nonlower semicontinuous functions is a difficult topic that has been minimally studied. Among such functions is a Heaviside composite function that is the composition of a Heaviside function with a possibly nonsmooth multivariate function. Unifying a statistical estimation problem with hierarchical selection of variables and a sample average approximation of composite chance constrained stochastic programs, a Heaviside composite optimization problem is one whose objective and constraints are defined by sums of possibly nonlinear multiples of such composite functions. Via a pulled-out formulation, a pseudostationarity concept for a feasible point was introduced in an earlier work as a necessary condition for a local minimizer of a Heaviside composite optimization problem. The present paper extends this previous study in several directions: (a) showing that pseudostationarity is implied by (and thus, weaker than) a sharper subdifferential-based stationarity condition that we term epistationarity; (b) introducing a set-theoretic sufficient condition, which we term a local convexity-like property, under which an epistationary point of a possibly nonlower semicontinuous optimization problem is a local minimizer; (c) providing several classes of Heaviside composite functions satisfying this local convexity-like property; (d) extending the epigraphical formulation of a nonnegative multiple of a Heaviside composite function to a lifted formulation for arbitrarily signed multiples of the Heaviside composite function, based on which we show that an epistationary solution of the given Heaviside composite program with broad classes of B-differentiable component functions can in principle be approximately computed by surrogation methods. Funding: The work of Y. Cui was based on research supported by the National Science Foundation [Grants CCF-2153352, DMS-2309729, and CCF-2416172] and the National Institutes of Health [Grant 1R01CA287413-01]. The work of J.-S. Pang was based on research supported by the Air Force Office of Scientific Research [Grant FA9550-22-1-0045].

Analysis of a Class of Minimization Problems Lacking Lower Semicontinuity

The Minimization of Piecewise Functions: Pseudo Stationarity

Solving Nonsmooth Nonconvex Compound Stochastic Programs with Applications to Risk Measure Minimization

Variational Theory and Algorithms for a Class of Asymptotically Approachable Nonconvex Problems

A UNIFIED STUDY OF NONPARAMETRIC INFERENCE FOR MONOTONE FUNCTIONS

On inexact stochastic splitting methods for a class of nonconvex composite optimization problems with relative error

Hybrid Algorithms for Finding a D-Stationary Point of a Class of Structured Nonsmooth DC Minimization

Heaviside Set Constrained Optimization: Optimality and Newton Method

Classification and Treatment Learning with Constraints via Composite Heaviside Optimization: a Progressive MIP Method

Convergence analysis of stochastic higher-order majorization-minimization algorithms

Incremental Subgradient Methods for Minimizing The Sum of Quasi-convex Functions

Solving Nonsmooth and Nonconvex Compound Stochastic Programs with Applications to Risk Measure Minimization.

On Convergence Lemma and Convergence Stability for Piecewise Analytic Functions

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

The minimizer of the sum of two strongly convex functions

An optimal method for stochastic composite optimization

Nearly Optimal $L_p$ Risk Minimization

A precise bare simulation approach to the minimization of some distances. II. Further Foundations

Revisiting Inexact Fixed-Point Iterations for Min-Max Problems: Stochasticity and Structured Nonconvexity

A note on stationarity in constrained optimization