Abstract:In the optimization of complex systems where at best one can only evaluate the function being optimized, often via a simulation experimental process, Response Surface Methodology (RSM) is frequently the method of choice. However, RSM invariably employs a first-order steepest descent method, presumably because of the prohibitive cost of employing second-order designs, except for the canonical analysis that is conducted at termination. In this paper, we suggest the use of deflected/conjugate gradient approaches that can be gainfully employed to improve the performance of RSM. These methods involve the same effort per iteration and require only first-order designs. However, instead of discarding previously generated information, the method utilizes these computations to advantageously build upon accumulated knowledge regarding the second-order curvature of the function being optimized, hence accelerating convergence by circumventing the characteristic zigzagging of steepest descent methods. The proposed scheme is illustrated using various test examples from the literature for which optimal solutions are known and that serve the purpose of exhibiting the potential of the recommended methodology. This paper attempts to improve the search techniques being currently used in standard Response Surface Methodology (RSM) algorithms. RSM is a collection of mathematical and statistical techniques for experimental optimization. This work presents a novel RSM algorithm that incorporates certain gradient deflection methods, augmented with appropriate restarting criteria, as opposed to using the path of steepest descent as the only search direction. In order to investigate the use of the new RSM algorithm in comparison with the standard existing RSM techniques, a set of standard test functions is used, both with and without random perturbations. Computational results exhibit the improvements achieved under the proposed algorithm.

An Adaptive Framework for Costly Black-Box Global Optimization Based on Radial Basis Function Interpolation

A Stochastic Adaptive Radial Basis Function Algorithm for Costly Black-Box Optimization

A Fast Global Optimizer Based on Improved CS-RBF and Stochastic Optimal Algorithm

A Fast Global Optimal Technique Based On Combinations Of Improved Radial Basis Functions And Tabu Search Method

A Response Surface Methodology Based On Improved Compactly Supported Radial Basis Function And Its Application To Rapid Optimizations Of Electromagnetic Devices

Adjoint-Response Surface Method in Aerodynamic Shape Optimization of Turbomachinery Blades

Finding optimal points for expensive functions using adaptive RBF-based surrogate model via uncertainty quantification

A Modified Stochastic Response Surface Algorithm for Expensive Black-Box Global Optimization

Gradient-Based Response Surface Approximations for Design Optimization

Large-Scale Discrete Constrained Black-Box Optimization Using Radial Basis Functions

An Adaptive Optimal Strategy Based on the Combination of the Dynamic-Q Optimization Method and Response Surface Methodology

An efficient multi-objective optimization method based on the adaptive approximation model of the radial basis function

An improved response surface model and its applications in the fast and global optimizations of electromagnetic devices

An Adaptive Interpolating MLS Based Response Surface Model Applied to Design Optimizations of Electromagnetic Devices

Blackbox: A procedure for parallel optimization of expensive black-box functions

A Simultaneous Strategy Based on Radial Basis Function for Dynamic Optimization

A Fast Optimization Algorithm Based on Multi-RBF For High-Dimensional and Computationally Expensive Problems

An Enhanced Response Surface Methodology (RSM) Algorithm Using Gradient Deflection and Second-Order Search Strategies

An aRBF surrogate-assisted neighborhood field optimizer for expensive problems

A Modified Mnemonic Enhancement Optimization Method For Solving Parametric Nonlinear Programming Problems

A Hybrid Variable-Fidelity Global Approximation Modelling Method Combining Tuned Radial Basis Function Base and Kriging Correction