Abstract:Our objective is to devise an efficient optimization algorithm for estimating optimal well controls during the production optimization step of closed-loop reservoir management where the optimization algorithm does not require an adjoint method for the calculation of derivatives. Research within the TUPREP group strongly suggests that gradient-based algorithms will be the most efficient and reliable methods for estimating well controls to maximize the net present value (NPV), or cumulative oil recovery of an oil field. However, most major oil companies use commercial reservoir simulators to make future predictions of production, and such commercial simulators generally lack efficient gradient-based production optimization algorithms where computational efficiency demands that the gradient of the cost function (e.g., NPV or cumulative oil production over the life of the field) be computed by an adjoint method. Adding an adjoint solution without access to the source code is not feasible. Therefore, it is important to implement optimization algorithms that can be easily coupled with a commercial simulator simply by using the simulator as a black box. While many such gradient-free optimization algorithms are available, based on the excellent performance of gradient-based methods, it is desirable to develop a procedure that mimics the property of methods that use a gradient. One such method is the simultaneous perturbation stochastic approximation (SPSA) method which estimates a stochastic gradient by a procedure that is far more efficient than estimating the derivative with a finite difference approximation. The purpose of this study is to develop a computationally efficient version of the SPSA algorithm for the constrained production optimization problem involved in the optimal control step of closed-loop reservoir management. The SPSA is a stochastic optimization algorithm, which obtains its stochastic gradient by simultaneously perturbing all components of the well control vector in a stochastic way. Although the SPSA gradient is stochastic, it is always uphill for a sufficiently small perturbation size and its expectation is equal to the true gradient as the perturbation size goes to zero. The most challenging problem in production optimization is to honor state-control constraints which are nonlinear. The SPSA algorithm has been applied to production optimization problems with only bound constraints and implementations used in previous published work were computationally inefficient. In this study, the focus will be developing and implementing a computationally efficient SPSA algorithm for production optimization problems with general equality, inequality and bound constraints. Here, the bound constraints are converted into the new unbounded control variables using a log-transformation. Although the results are not shown in this work, simply truncating control variables at their bounds consistently yields slightly lower NPVs values than are obtained with the log-transform method used here. All constraints are incorporated into the objective function to be maximized using the augmented Lagrangian function. The advantage of this method is that the general inequality and equality constraints can conceptually be handled using suitable values of the penalty parameter and Lagrange multipliers. In addition to the basic SPSA algorithm, which uses samples from the symmetric Bernoulli distribution as perturbations, a SPSA type algorithm that uses samples from Gaussian distribution is also tested. To improve the efficiency of the SPSA algorithm, a combined search direction SPSA algorithm is proposed, in which the search direction is a combination of the current SPSA gradient and the "best" SPSA gradient or some "good" former SPSA gradients calculated in the last few iterations.

A Two-Stage Well Placement Optimization Method Based on Adjoint Gradient

Optimal Well Placement Using an Adjoint Gradient

Optimal Well Placement for Production Optimization

A Variable-Control Well Placement Optimization for Improved Reservoir Development

Optimization of the Well Locations and Completions for Vertical and Horizontal Wells Using a Derivative-Free Optimization Algorithm

Hybrid FDG optimization method and kriging interpolator to optimize well locations

A New Gradient-Accelerated Two-Stage Multiobjective Optimization Method for CO2-Alternating-Water Injection in an Oil Reservoir

Derivative-free search approaches for optimization of well inflow control valves and controls

A Robust Optimization Approach of Well Placement for Doublet in Heterogeneous Geothermal Reservoirs Using Random Forest Technique and Genetic Algorithm

Generalized Field Development Optimization: Coupled Well-Placement and Control under Geologic Uncertainty

Locating optimal position of artificial recharge wells in aquifer using grey wolf optimization algorithm and isogeometric numerical method

A field development strategy for the joint optimization of flow allocations, well placements and well trajectories

A simultaneous perturbation stochastic approximation algorithm for coupled well placement and control optimization under geologic uncertainty

Infill well placement optimization for secondary development of waterflooding oilfields with SPSA algorithm

A two-stage optimization strategy for large-scale oil field development

Application of spsa-type algorithms to production optimization

Use of low-fidelity models with machine-learning error correction for well placement optimization

Efficient Ensemble-Based Closed-Loop Production Optimization

Automatic Optimization of Multi-Well Multi-Stage Fracturing Treatments Combining Geomechanical Simulation, Reservoir Simulation and Intelligent Algorithm

Offset Well Design Optimization Using Surrogate Model and Metaheuristic Algorithms: A Bakken Case Study

Well control optimization using derivative-free algorithms and a multiscale approach