Abstract:Risk and sparsity requirements often need to be enforced simultaneously in many applications, e.g., in portfolio optimization, assortment planning, and treatment planning. Properly balancing these potentially conflicting requirements entails the formulation of functional constrained optimization with either convex or nonconvex objectives. In this paper, we focus on projection-free methods that can generate a sparse trajectory for solving these challenging functional constrained optimization problems. Specifically, for the convex setting, we propose a Level Conditional Gradient (LCG) method, which leverages a level-set framework to update the approximation of the optimal value and an inner conditional gradient oracle (CGO) for solving mini-max subproblems. We show that the method achieves $\mathcal{O}\big(\frac{1}{\epsilon^2}\log\frac{1}{\epsilon}\big)$ iteration complexity for solving both smooth and nonsmooth cases without dependency on a possibly large size of optimal dual Lagrange multiplier. For the nonconvex setting, we introduce the Level Inexact Proximal Point (IPP-LCG) method and the Direct Nonconvex Conditional Gradient (DNCG) method. The first approach taps into the advantage of LCG by transforming the problem into a series of convex subproblems and exhibits an $\mathcal{O}\big(\frac{1}{\epsilon^3}\log\frac{1}{\epsilon}\big)$ iteration complexity for finding an ($\epsilon,\epsilon$)-KKT point. The DNCG is the first single-loop projection-free method, with iteration complexity bounded by $\mathcal{O}\big(1/\epsilon^4\big)$ for computing a so-called $\epsilon$-Wolfe point. We demonstrate the effectiveness of LCG, IPP-LCG and DNCG by devising formulations and conducting numerical experiments on two risk averse sparse optimization applications: a portfolio selection problem with and without cardinality requirement, and a radiation therapy planning problem in healthcare.

Goal-Driven Optimization

Online Successive Convex Approximation for Two-Stage Stochastic Nonconvex Optimization

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Robust Data-Driven CARA Optimization

Uncertainty Handling In Goal-Driven Self-Optimization - Limiting The Negative Effect On Adaptation

A Functional Model Method for Nonconvex Nonsmooth Conditional Stochastic Optimization

Distributionally robust goal-reaching optimization in the presence of background risk

Algorithms for stochastic optimization with functional or expectation constraints

Robust CARA Optimization

On penalized goal-reaching probability minimization under borrowing and short-selling constraints

A Goal Programming Model with Satisfaction Function for Risk Management and Optimal Portfolio Diversification

A Bayesian Risk Approach to Data-driven Stochastic Optimization: Formulations and Asymptotics

Optimization with Reference-Based Robust Preference Constraints

A Data-Driven Approach to Multistage Stochastic Linear Optimization

Towards Global Solutions for Nonconvex Two-Stage Stochastic Programs: A Polynomial Lower Approximation Approach

SMGO-$Δ$: Balancing Caution and Reward in Global Optimization with Black-Box Constraints

Functional Constrained Optimization for Risk Aversion and Sparsity Control

Sequential model based optimization of partially defined functions under unknown constraints

Multivariate Robust Second-Order Stochastic Dominance and Resulting Risk-Averse Optimization

Stochastic Optimization with Parametric Cost Function Approximations