Abstract:This paper intends to apply the sample-average-approximation (SAA) scheme to solve a system of stochastic equations (SSE), which has many applications in a variety of fields. The SAA is an effective paradigm to address risks and uncertainty in stochastic models from the perspective of Monte Carlo principle. Nonetheless, a numerical conflict arises from the sample size of SAA when one has to make a tradeoff between the accuracy of solutions and the computational cost. To alleviate this issue, we incorporate a gradually reinforced SAA scheme into a differentiable homotopy method and develop a gradually reinforced sample-average-approximation (GRSAA) differentiable homotopy method in this paper. By introducing a series of continuously differentiable functions of the homotopy parameter $t$ ranging between zero and one, we establish a differentiable homotopy system, which is able to gradually increase the sample size of SAA as $t$ descends from one to zero. The set of solutions to the homotopy system contains an everywhere smooth path, which starts from an arbitrary point and ends at a solution to the SAA with any desired accuracy. The GRSAA differentiable homotopy method serves as a bridge to link the gradually reinforced SAA scheme and a differentiable homotopy method and retains the nice property of global convergence the homotopy method possesses while greatly reducing the computational cost for attaining a desired solution to the original SSE. Several numerical experiments further confirm the effectiveness and efficiency of the proposed method.

Rates of convergence of sample average approximation under heavy tailed distributions

Approximation of the Tail Probability of Randomly Weighted Sums and Applications

Uniform exponential convergence of SAA with AMIS and asymptotics of its optimal value

Sample Average Approximation Method for a Class of Stochastic Variational Inequality Problems.

The Asymptotic Distribution and Berry–Esseen Bound of a New Test for Independence in High Dimension with an Application to Stochastic Optimization

Asymptotic Time-Uniform Inference for Parameters in Averaged Stochastic Approximation

Nonasymptotic Upper Estimates for Errors of the Sample Average Approximation Method to Solve Risk-Averse Stochastic Programs

On sample average approximation for two-stage stochastic programs without relatively complete recourse

Sample Average Approximation for Stochastic Programming with Equality Constraints

Metric Entropy-Free Sample Complexity Bounds for Sample Average Approximation in Convex Stochastic Programming

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Generalization Analysis of Stochastic Weight Averaging with General Sampling

Multilevel Monte Carlo in Sample Average Approximation: Convergence, Complexity and Application

0/1 Constrained Optimization Solving Sample Average Approximation for Chance Constrained Programming

Mean-Square Analysis of Discretized Itô Diffusions for Heavy-tailed Sampling

Fast convergence of sample-average approximation for saddle-point problems

A Gradually Reinforced Sample-Average-Approximation Differentiable Homotopy Method for a System of Stochastic Equations

Convergence of Distributed Stochastic Variance Reduced Methods Without Sampling Extra Data

Bias Reduction in Sample-Based Optimization

Optimal Rates for the Last Iterate of the Stochastic subgradient Method under Heavy-Tails