Abstract:We consider a class of convex risk-neutral PDE-constrained optimization problems subject to pointwise control and state constraints. Due to the many challenges associated with almost sure constraints on pointwise evaluations of the state, we suggest a relaxation via a smooth functional bound with similar properties to well-known probability constraints. First, we introduce and analyze the relaxed problem, discuss its asymptotic properties, and derive formulae for the gradient the adjoint calculus. We then build on the theoretical results by extending a recently published online convex optimization algorithm (OSA) to the infinite-dimensional setting. Similar to the regret-based analysis of time-varying stochastic optimization problems, we enhance the method further by allowing for periodic restarts at pre-defined epochs. Not only does this allow for larger step sizes, it also proves to be an essential factor in obtaining high-quality solutions in practice. The behavior of the algorithm is demonstrated in a numerical example involving a linear advection–diffusion equation with random inputs. In order to judge the quality of the solution, the results are compared to those arising from a sample average approximation (SAA). This is done first by comparing the resulting cumulative distributions of the objectives at the optimal solution as a function of step numbers and epoch lengths. In addition, we conduct statistical tests to further analyze the behavior of the online algorithm and the quality of its solutions. For a sufficiently large number of steps, the solutions from OSA and SAA lead to random integrands for the objective and penalty functions that appear to be drawn from similar distributions.

Sample Size Estimates for Risk-Neutral Semilinear PDE-Constrained Optimization

Nonasymptotic Upper Estimates for Errors of the Sample Average Approximation Method to Solve Risk-Averse Stochastic Programs

Sample Average Approximation for Stochastic Programming with Equality Constraints

A relaxation-based probabilistic approach for PDE-constrained optimization under uncertainty with pointwise state constraints

On sample average approximation for two-stage stochastic programs without relatively complete recourse

Consistency of sample-based stationary points for infinite-dimensional stochastic optimization

Reliable Error Estimates for Optimal Control of Linear Elliptic PDEs with Random Inputs

Robust Stochastic Approximation Approach to Stochastic Programming

Bias Reduction in Sample-Based Optimization

SAA Method Based on Modified Newton Method for Stochastic Variational Inequality with Second-Order Cone Constraints and Application in Portfolio Optimization

On Sample Average Approximation Algorithms for Determining the Optimal Importance Sampling Parameters in Pricing Financial Derivatives on Lévy Processes

Sample Average Approximation Method for a Class of Stochastic Variational Inequality Problems.

0/1 Constrained Optimization Solving Sample Average Approximation for Chance Constrained Programming

Concentration Bounds for Optimized Certainty Equivalent Risk Estimation

A Sample Average Approximation Regularization Method for a Stochastic Mathematical Program with General Vertical Complementarity Constraints

Subsampled Optimization: Statistical Guarantees, Mean Squared Error Approximation, and Sampling Method

Optimization of utility-based shortfall risk: A non-asymptotic viewpoint

Nonasymptotic Bounds for Suboptimal Importance Sampling

A Gradually Reinforced Sample-Average-Approximation Differentiable Homotopy Method for a System of Stochastic Equations

Uses of Sub-sample Estimates to Reduce Errors in Stochastic Optimization Models