Abstract:Conditional Nonlinear Optimal Perturbation (CNOP) is widely used in atmospheric and oceanic predictability studies. Solving CNOP is essentially a nonlinear optimization problem with certain constraints. One method to solve CNOP is the intelligent optimization algorithm. But it may not always obtain the satisfactory solution and efficiency because of the local exploitation of individual particles. The Bayesian optimization algorithm can avoid this local stagnation by building a global probability grasp for the optimization space of CNOP. Nonetheless, the limit of approximately 20-dimensional optimization space hampers its application in solving CNOP of high-dimensional numerical models. To overcome this bottleneck, we propose a paralleled embedding high-dimensional Bayesian optimization with additive Gaussian kernels (PEBOA) algorithm, which mainly consists of the feature extraction process and low-dimensional optimization process. In PEBOA, a feature extraction method (deepFE) using the convolutional Autoencoder with residual connections and customized constraint-preserved loss function is designed, which compresses 10 million dimensional data to relatively low-dimensional search spaces, from tens to hundreds of dimensions. Then, we propose the strategy of additive Gaussian kernels, with which the Bayesian optimization algorithm can optimize in relatively low-dimensional search spaces. Concretely, a kernel handles a subspace, and a subspace can handle dimensions approximately not more than 20. Additionally, the modified acquisition function can sample multiple candidates simultaneously with the aim of accelerating the optimization process. We apply PEBOA to solve CNOP of Regional Ocean Modeling System (ROMS) for identifying optimal initial errors of upstream Kuroshio transport variation, which is a 10 million dimensional and time-consuming problem. The computational performance of PEBOA and physical mechanisms of the obtained CNOP are analyzed. Experimental results indicate that deepFE excels Principal Component Analysis (PCA) in terms of relative error ratio, the magnitude of objective function values, and the obtained CNOP pattern. Besides, compared to deepFE-based Particle Swarm Optimization, PEBOA has better solving efficiency with 3.4% larger objective function values and 2.2 times greater likelihood of obtaining the valid CNOP. Furthermore, the modified acquisition function reduces computation time by about 71.0% with four cores. The physical mechanism analysis shows that CNOPs obtained by PEBOA are almost identical to the adjoint method, which can cause an anomalous increase (decrease) in upstream Kuroshio transport and maintain physics consistency.

A high-dimensional optimization method combining projection correlation-based Kriging and multimodal parallel computing

A distance correlation-based Kriging modeling method for high-dimensional problems

A global optimization strategy based on the Kriging surrogate model and parallel computing

An efficient kriging modeling method for high-dimensional design problems based on maximal information coefficient

An Improved High-Dimensional Kriging Surrogate Modeling Method through Principal Component Dimension Reduction

High-dimensional Bayesian optimization using low-dimensional feature spaces

A PC-Kriging-HDMR integrated with an adaptive sequential sampling strategy for high-dimensional approximate modeling

Surrogate-based optimization with clustering-based space exploration for expensive multimodal problems

Weighted Gradient-Enhanced Kriging for High-Dimensional Surrogate Modeling and Design Optimization

Exploiting active subspaces of hyperparameters for efficient high-dimensional Kriging modeling

Surrogate Information Transfer and Fusion in High-Dimensional Expensive Optimization Problems

High Dimensional Bayesian Optimization Assisted by Principal Component Analysis

Towards Efficient High-Dimensional Aerodynamic Shape Optimization: Surrogate Modeling Via Gradient-Enhanced Kriging

An improved optimization method combining particle swarm optimization and dimension reduction kriging surrogate model for high-dimensional optimization problems

Optimal Tuning of Kriging Hyper- Parameters Based on Cuckoo Search Algorithm

High Dimensional Bayesian Optimization with Kernel Principal Component Analysis

A Paralleled Embedding High-Dimensional Bayesian Optimization with Additive Gaussian Kernels for Solving CNOP

An Adaptive Dual-Kriging Method Based on Parameter Sensitivity Analysis and Application to Vibration Reduction Optimization of Helicopter Rotor Test-Bed

Multiple Surrogate-Model-Based Optimization Method Using the Multimodal Expected Improvement Criterion for Expensive Problems

An Enhanced Kriging Surrogate Modeling Technique for High-Dimensional Problems

An Improved Sufficient Dimension Reduction-Based Kriging Modeling Method for High-Dimensional Evaluation-Expensive Problems