Single/Multi-objective Inverse Robust Evolutionary Design Methodology in the Presence of Uncertainty

Dudy Lim,Yew-soon Ong,Meng-hiot Lim,Yaochu Jin

DOI: https://doi.org/10.1007/978-3-540-49774-5_19

2007-01-01

Abstract:Without Abstract

What problem does this paper attempt to address?

Inverse Multi-Objective Robust Evolutionary Design.

Dudy Lim,Yew-Soon Ong,Yaochu Jin,Bernhard Sendhoff,Bu Sung Lee

DOI: https://doi.org/10.1007/s10710-006-9013-7

2006-01-01

Genetic Programming and Evolvable Machines

Abstract:In this paper, we present an Inverse Multi-Objective Robust Evolutionary (IMORE) design methodology that handles the presence of uncertainty without making assumptions about the uncertainty structure. We model the clustering of uncertain events in families of nested sets using a multi-level optimization search. To reduce the high computational costs of the proposed methodology we proposed schemes for (1) adapting the step-size in estimating the uncertainty, and (2) trimming down the number of calls to the objective function in the nested search. Both offline and online adaptation strategies are considered in conjunction with the IMORE design algorithm. Design of Experiments (DOE) approaches further reduce the number of objective function calls in the online adaptive IMORE algorithm. Empirical studies conducted on a series of test functions having diverse complexities show that the proposed algorithms converge to a set of Pareto-optimal design solutions with non-dominated nominal and robustness performances efficiently.
A Direct Coupled Solution Methodology for Efficient Robust Optimizations of Inverse Problems under Uncertainty

Siu Lau Ho,Shiyou Yang,Yanan Bai,Jin Huang

DOI: https://doi.org/10.1109/tmag.2014.2358614

IF: 1.848

2015-01-01

IEEE Transactions on Magnetics

Abstract:In the existing resolution methodology for robust design optimizations, the procedures for solving robust optimization and uncertainty quantization as well as the use of high fidelity models are completely decoupled and independent from each other. As a result, the overall cost is typically the product of the costs of the three approaches. Such methodology is simple but more expensive than necessary. To develop an efficient robust optimizer, a direct coupled solution methodology based on an evolutionary algorithm is proposed. Stochastic approximation method is employed to minimize the computational burdens when computing the gradient information in designing the exploiting phase. Numerical results are reported to showcase the merits of the proposed methodology.
Multistage Robust Mixed-Integer Optimization under Endogenous Uncertainty

Wei Feng,Yiping Feng,Qi Zhang

DOI: https://doi.org/10.1016/j.ejor.2021.01.048

IF: 6.4

2021-01-01

European Journal of Operational Research

Abstract:Endogenous, i.e. decision-dependent, uncertainty has received increased interest in the stochastic programming community. In the robust optimization context, however, it has rarely been considered. This work addresses multistage robust mixed-integer optimization with decision-dependent uncertainty sets. The proposed framework allows us to consider both continuous and integer recourse, including recourse decisions that affect the uncertainty set. We derive a tractable reformulation of the problem by leveraging recent advances in the construction of nonlinear decision rules, and introduce discontinuous piecewise linear decision rules for continuous recourse. Computational experiments are performed to gain insights on the impact of endogenous uncertainty, the benefit of discrete recourse, and computational performance. Our results indicate that the level of conservatism in the solution can be significantly reduced if endogenous uncertainty and mixed-integer recourse are properly modeled.
Simulation-Based Robust Design of Complex Product Considering Uncertainties of Metamodel, Design Variables, and Noise Parameters

Zhenyu Liu,Xiang Peng,Chan Qiu,Jianrong Tan,Guifang Duan,Jin Cheng

DOI: https://doi.org/10.1177/0954406216654938

2017-01-01

Abstract:The uncertainties of design variables, noise parameters, and metamodel are important factors in simulation-based robust design optimization. Most conventional metamodel construction methods only consider one or two uncertainties. In this paper, a new surrogate modeling method simultaneously measuring all the uncertainties is proposed for simulation-based robust design optimization of complex product. The effect of metamodel uncertainty on product performance uncertainty is quantified through uncertainty propagation analysis among design variables uncertainty, noise parameters uncertainty, metamodel uncertainty, and performance uncertainty. Then, the sampling points are selected and the metamodel is constructed based on the predictive interval of product performance and mean square error of the Kriging metamodel. The constructed metamodel is applied to robust design optimization considering multiple uncertainties. Results of two mathematical examples show that the proposed metamodel considering multiple uncertainties increases the result accuracy of robust design optimization. Finally, the proposed algorithm is applied to robust design optimization of a heat exchanger, and the total heat transfer rate is enhanced under uncertainties of fin structural parameters, operation conditions parameters and simulation metamodel.
A New Methodology for Robust Optimizations of Optimal Design Problems under Interval Uncertainty

Shiyou Yang,Jiaqiang Yang,Yanan Bai,Guangzheng Ni

DOI: https://doi.org/10.1109/tmag.2015.2483526

IF: 1.848

2016-01-01

IEEE Transactions on Magnetics

Abstract:To consider the interval uncertainty in a practical optimal design problem, a new methodology for efficient robust optimizations is proposed. The proposed methodology uses a constrained formulation for robust performances not only in alleviating the inefficiency of the existing approaches in modeling interval uncertainties but also in avoiding the deficiency in the biasing force selection. The gradient information is used as both a trigger to activate the uncertain quantification procedure and the steepest increment direction to develop a fast searching phase. The stochastic approximation method is employed to minimize the computational burdens in computing the gradients. The numerical results on a case study are reported to validate the proposed methodology.
Non-Probabilistic Robust Equilibrium Optimization of Complex Uncertain Structures

Jin Cheng,Zhenyu Liu,Yangming Qian,Zhendong Zhou,Jianrong Tan

DOI: https://doi.org/10.1115/1.4044322

2019-01-01

Journal of Mechanical Design

Abstract:Robust optimization of complex uncertain structures usually involves multiple conflicting and competing structural performance indices. Present approaches for achieving the final design of such an optimization problem always involve a decision-making process, which is a demanding task that requires the rich experience and expert skills of designers. To overcome the difficulty, an interval robust equilibrium optimization approach is proposed to find the optimal design of complex uncertain structure based on the robust equilibrium strategy for multiple conflicting and competing structural performance indices. Specifically, a new concept of closeness and crossing coefficient between interval boundaries (CCCIBs) is proposed atfirst, based on which the tri-dimensional violation vectors of all interval constraints can be calculated and the feasibility of a design vector can be assessed. Then, the robust equilibrium assessment of multiple objective and constraint performance indices is investigated, based on the results of which the feasible design vectors can be directly ranked according to the robust equilibrium strategy for all structural performance indices. Subsequently, the algorithm for the robust equilibrium optimization of complex uncertain structures is developed by integrating the Kriging technique and nested genetic algorithm. The validity, effectiveness, and practicability of the proposed approach are demonstrated by two illustrative examples.
Robust Optimization Using a Methodology Based on Cross Entropy Methods

S. L. Ho,Shiyou Yang,Yingying Yao,W. N. Fu

DOI: https://doi.org/10.1109/tmag.2010.2090865

IF: 1.848

2011-01-01

IEEE Transactions on Magnetics

Abstract:To address the performance degradations of optimal designs arising from uncertainties using traditional concepts and methodologies, a robust oriented cross entropy method is proposed. To efficiently compute the solutions with robust performances, the normal distribution function is used as the probability density function, and a methodology for evaluating and assigning robust performance to promising solutions is proposed. A statistical model is introduced for the constraint functions to enhance the quality of the final design. To find the global and robust optimal solutions simultaneously in a single run, the original objective rather than the robust performance parameters is used for selecting the elite solutions. Two examples are reported to validate the proposed algorithm.
Heterogeneous-Objective Robust Optimization of Complex Mechatronic Components Considering Interval Uncertainties

Jin Cheng,Yangming Qian,Zhenyu Liu,Yixiong Feng,Zhendong Zhou,Jianrong Tan

DOI: https://doi.org/10.1109/access.2019.2894774

IF: 3.9

2019-01-01

IEEE Access

Abstract:Structural optimization of complex mechatronic components may involve heterogeneous competing performance indices, including the cost, fixation, benefit, and deviation ones. However, such optimization problems with heterogeneous objectives have not been investigated so far. In this paper, a novel interval heterogeneous-objective robust optimization approach is proposed for complex mechatronic components. First, a unified interval heterogeneous-objective robust optimization model is constructed for mechatronic components with the uncertainties described as interval variables. Subsequently, a new interval robust equilibrium optimization algorithm is proposed to solve the interval heterogeneous-objective robust optimization model. Specifically, the unified formulas for assessing the robustness of interval heterogeneous-objective performance indices and the robust equilibrium among them are derived at first. Then, the preferential guidelines considering the robust equilibrium among all the objective and constraint performance indices are proposed for the direct ranking of various design vectors, and finally, the heterogeneous-objective robust equilibrium optimization of complex mechatronic components is realized by integrating the Kriging technique and the nested genetic algorithm. The feasibility and effectiveness of the proposed heterogeneous-objective robust optimization approach are verified by a numerical example and a case study.
Robust Optimization and Sensitivity Analysis with Multi-Objective Genetic Algorithms: Single- and Multi-Disciplinary Applications

Mian Li

2007-01-01

Abstract:: Uncertainty is inevitable in engineering design optimization and can significantly degrade the performance of an optimized design solution and/or even change a feasible solution to infeasible. The problem with uncertainty can be exacerbated in multi-disciplinary optimization whereby the models for several disciplines are coupled and the propagation of uncertainty has to be accounted for within and across disciplines. It is important to determine which ranges of parameter uncertainty are most important or how to best allocate investments to partially or fully reduce uncertainty under a limited budget. This dissertation concentrates on a new robust optimization approach and a new sensitivity analysis approach for multi-objective and multi-disciplinary design optimization problems that have parameters with interval uncertainty. The dissertation presents models and approaches under four research thrusts. In the first, an approach is presented to obtain robustly optimal solutions which are as best as possible, in a multi-objective sense, and at the same time their sensitivity of objective and/or constraint functions is within an acceptable range. In the second the robust optimization approach in the first thrust is extended to design optimization problems which are decomposed into multiple subproblems, each with multiple objectives and constraints. In the third, a new approach for multi-objective sensitivity analysis and uncertainty reduction is presented. And in the final research thrust, a metamodel embedded Multi-Objective Genetic Algorithm (MOGA) for solution of design optimization problems is presented. The new MOGA requires a significantly fewer number of simulation calls, when used to solve multi-objective design optimization problems, compared to previously developed MOGA methods while obtaining comparable solutions.
A robust multi-objective Bayesian optimization framework considering input uncertainty

Jixiang Qing,Ivo Couckuyt,Tom Dhaene

DOI: https://doi.org/10.1007/s10898-022-01262-9

2022-12-10

Journal of Global Optimization

Abstract:Bayesian optimization is a popular tool for optimizing time-consuming objective functions with a limited number of function evaluations. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as input uncertainty into account to find a set of robust solutions. While this is an active topic in single-objective Bayesian optimization, it is less investigated in the multi-objective case. We introduce a novel Bayesian optimization framework to perform multi-objective optimization considering input uncertainty. We propose a robust Gaussian Process model to infer the Bayes risk criterion to quantify robustness, and we develop a two-stage Bayesian optimization process to search for a robust Pareto frontier, i.e., solutions that have good average performance under input uncertainty. The complete framework supports various distributions of the input uncertainty and takes full advantage of parallel computing. We demonstrate the effectiveness of the framework through numerical benchmarks.

mathematics, applied,operations research & management science
New Robust Optimization Approach Induced by Flexible Uncertainty Set: Optimization under Continuous Uncertainty

Yi Zhang,Yiping Feng,Gang Rong

DOI: https://doi.org/10.1021/acs.iecr.6b02989

2017-01-01

Industrial & Engineering Chemistry Research

Abstract:In the real-world optimization problems, continuous uncertainties (such as field uncertainty and demand uncertainty) are usually unbounded and have unknown probability density functions, which have significant influences on the fluctuation in production. As the classical robust counterpart optimization approach is mainly for dealing with bounded uncertainties, the concept of "flexible uncertainty set" is proposed on the basis of the definitions of the classical box, ellipsoidal, and polyhedral uncertainty sets. Next, the continuous uncertainties can be transformed into bounded ones, which are connected with a predefined "confidence level". Moreover, their corresponding robust formulations and a priori probability bounds of constraints' violation are derived and proven in detail. Several numerical examples (including a real-world process industry example) are introduced to illustrate the new formulations induced by flexible uncertainty sets, which have been proven less conservative and with tight probability bounds of constraints' violation.
A New Hybrid Algorithm for Multi-Objective Robust Optimization with Interval Uncertainty

Shuo Cheng,Jianhua Zhou,Mian Li

DOI: https://doi.org/10.1115/1.4029026

2015-01-01

Journal of Mechanical Design

Abstract:Uncertainty is a very critical but inevitable issue in design optimization. Compared to single-objective optimization problems, the situation becomes more difficult for multi-objective engineering optimization problems under uncertainty. Multi-objective robust optimization (MORO) approaches have been developed to find Pareto robust solutions. While the literature reports on many techniques in MORO, few papers focus on using multi-objective differential evolution (MODE) for robust optimization (RO) and performance improvement of its solutions. In this article, MODE is first modified and developed for RO problems with interval uncertainty, formulating a new MODE-RO algorithm. To improve the solutions' quality of MODE-RO, a new hybrid (MODE-sequential quadratic programming (SQP)-RO) algorithm is proposed further, where SQP is incorporated into the procedure to enhance the local search. The proposed hybrid approach takes the advantage of MODE for its capability of handling not-well behaved robust constraint functions and SQP for its fast local convergence. Two numerical and one engineering examples, with two or three objective functions, are tested to demonstrate the applicability and performance of the proposed algorithms. The results show that MODE-RO is effective in solving MORO problems while, on the average, MODE-SQP-RO improves the quality of robust solutions obtained by MODE-RO with comparable numbers of function evaluations.
Trade-ofi between Optimality and Robustness: An Evolutionary Multiobjective Approach

Yaochu Jin,Bernhard Sendhofi

2003-01-01

Abstract:In real-world applications, it is often desired that a solu- tion is not only of high performance, but also of strong robustness. In evolutionary optimization, robust optimal solutions can be obtained ei- ther by averaging the fltness in the neighborhood or by perturbing the design variables in fltness evaluations. Unfortunately, only one solution can usually be obtained from one run of optimization using the existing methods for searching robust solutions. Besides, the user knows little about the performance degradation due to the improvement of robust- ness of a solution using these methods. This paper suggests two methods for estimating the robustness of a solution by exploiting the information available in the current population of the evolutionary algorithm, with- out any additional fltness evaluations. The estimated robustness is then used as an additional objective in optimization. Thus, a trade-ofi between optimality and robustness can be realized with the help of evolutionary multiobjective optimization. Simulation studies have been conducted to verify the proposed method. Finally, the possibility of using this method for detecting multiple optima of multimodal functions is brie∞y discussed.
Integrated multi-objective robust optimization and sensitivity analysis with irreducible and reducible interval uncertainty

M. Li,S. Azarm,N. Williams,S. Al Hashimi,A. Almansoori,N. Al Qasas

DOI: https://doi.org/10.1080/03052150902853005

IF: 2.5

2009-01-01

Engineering Optimization

Abstract:Uncertainty considered in robust optimization is usually treated as irreducible since it is not reduced during an optimization procedure. In contrast, uncertainty considered in sensitivity analysis is treated as partially or fully reducible in order to quantify the effect of input uncertainty on the outputs of the system. Considering this, and the usual existence of both reducible and irreducible uncertainty, an approach that can perform robust optimization and sensitivity analysis simultaneously is of much interest. This article presents such an integrated optimization model that can be used for both robust optimization and sensitivity analysis for problems that have irreducible and reducible interval uncertainty, multiple objective functions and mixed continuous-discrete design variables. The proposed model is demonstrated by two engineering examples with differing complexity to demonstrate its applicability.
Time-Dependent Reliability-Based Robust Design Optimization Using Evolutionary Algorithm

Shui Yu,Zhonglai Wang,Zhihua Wang

DOI: https://doi.org/10.1115/1.4042921

2019-04-15

Abstract:Due to the uncertain and dynamic parameters from design, manufacturing, and working conditions, many engineering structures usually show uncertain and dynamic properties. During the product design and development stages, designers often encounter reliability and robustness measures of dynamic uncertain structures. Time-varying and high nonlinear performance brings a new challenge for the reliability-based robust design optimization. This paper proposes a multi-objective integrated framework for time-dependent reliability-based robust design optimization and the corresponding algorithms. The integrated framework is first established by minimizing the mean value and coefficient of variation of the objective performance at the same time subject to time-dependent probabilistic constraints. The time-dependent probabilistic constraints are then converted into deterministic constraints using the dimension reduction method. The evolutionary multi-objective optimization algorithm is finally employed for the deterministic multi-objective optimization problem. Several examples are investigated to demonstrate the effectiveness of the proposed method.
A Sequential Robust Optimization Approach for Multidisciplinary Design Optimization with Uncertainty

Tingting Xia,Mian Li,Jianhua Zhou

DOI: https://doi.org/10.1115/1.4034113

2016-01-01

Abstract:One real challenge for multidisciplinary design optimization (MDO) problems to gain a robust solution is the propagation of uncertainty from one discipline to another. Most existing methods only consider an MDO problem in the deterministic manner or find a solution which is robust for a single-disciplinary optimization problem. These rare methods for solving MDO problems under uncertainty are usually computationally expensive. This paper proposes a robust sequential MDO (RS-MDO) approach based on a sequential MDO (S-MDO) framework. First, a robust solution is obtained by giving each discipline full autonomy to perform optimization without considering other disciplines. A tolerance range is specified for each coupling variable to take care of uncertainty propagation in the coupled system. Then the obtained robust extreme points of global variables and coupling variables are dispatched into subsystems to perform robust optimization (RO) sequentially. Additional constraints are added in each subsystem to keep the consistency and to guarantee a robust solution. To find a solution with such strict constraints, genetic algorithm (GA) is used as a solver in each optimization stage. The proposed RS-MDO can save significant amount of computational efforts by using the sequential optimization procedure. Since all iterations in the sequential optimization stage can be processed in parallel, this robust MDO approach can be more time-saving. Numerical and engineering examples are provided to demonstrate the availability and effectiveness of the proposed approach.
Trade-off Between Performance and Robustness: an Evolutionary Multiobjective Approach

Yaochu Jin,Bernhard Sendhoff

DOI: https://doi.org/10.1007/3-540-36970-8_17

2003-01-01

Abstract:In real-world applications, it is often desired that a solution is not only of high performance, but also of high robustness. In this context, a solution is usually called robust, if its performance only gradually decreases when design variables or environmental parameters are varied within a certain range. In evolutionary optimization, robust optimal solutions are usually obtained by averaging the fitness over such variations. Frequently, maximization of the performance and increase of the robustness are two conflicting objectives, which means that a trade-off exists between robustness and performance. Using the existing methods to search for robust solutions, this trade-off is hidden and predefined in the averaging rules. Thus, only one solution can be obtained. In this paper, we treat the problem explicitly as a multi objective optimization task, thereby clearly identifying the trade-off between performance and robustness in the form of the obtained Pareto front. We suggest two methods for estimating the robustness of a solution by exploiting the information available in the current population of the evolutionary algorithm, without any additional fitness evaluations. The estimated robustness is then used as an additional objective in optimization. Finally, the possibility of using this method for detecting multiple optima of multimodal functions is briefly discussed.
Research on Multi-Objective Robust Design

Huanwei Xu,Hong-Zhong Huang,Zhonglai Wang,Bin Zheng,Debiao Meng

DOI: https://doi.org/10.1109/icqr2mse.2011.5976748

2011-01-01

Abstract:Robust design optimization holds the multiple aspects of the objective. In this paper the basic robust design model was established based on maximum variation estimation method; the multi-objective attribute of robust design was analyzed; the Pareto robust set was defined; the values of performance functions were adjusted with the combination of linear physical programming. Finally multi-objective robust design model which doesn't require presumed probability distribution of uncertain factors or continuous and differentiable of objective and constraints functions was constructed. An engineering example was provided and the results show that the proposed approach can ensure success of optimization and obtain the solution which reflects decision-maker's preference.
ERGO: A New Robust Design Optimization Technique Combining Multi-Objective Bayesian Optimization With Analytical Uncertainty Quantification

Jolan Wauters

DOI: https://doi.org/10.1115/1.4052009

2021-10-01

Journal of Mechanical Design

Abstract:Abstract In this work, robust design optimization (RDO) is treated, motivated by the increasing desire to account for variability in the design phase. The problem is formulated in a multi-objective setting with the objective of simultaneously minimizing the mean of the objective and its variance due to variability of design variables and/or parameters. This allows the designer to choose its robustness level without the need to repeat the optimization as typically encountered when formulated as a single objective. To account for the computational cost that is often encountered in RDO problems, the problem is fitted in a Bayesian optimization framework. The use of surrogate modeling techniques to efficiently solve problems under uncertainty has effectively found its way in the optimization community leading to surrogate-assisted optimization-under-uncertainty schemes. The Gaussian processes, the surrogates on which Bayesian optimization builds, are often considered cheap-to-sample black-boxes and are sampled to obtain the desired quantities of interest. However, since the analytical formulation of these surrogates is known, an analytical treatment of the problem is available. To obtain the quantities of interest without sampling an analytical uncertainty, propagation through the surrogate is presented. The multi-objective Bayesian optimization framework and the analytical uncertainty quantification are linked together through the formulation of the robust expected improvement, obtaining the novel efficient robust global optimization scheme. The method is tested on a series of test cases to examine its behavior for varying difficulties and validated on an aerodynamic test function which proves the effectiveness of the novel scheme.

engineering, mechanical
Evolutionary Optimization in Uncertain Environments-a Survey

Y Jin,H Branke

DOI: https://doi.org/10.1109/tevc.2005.846356

IF: 16.497

2005-01-01

IEEE Transactions on Evolutionary Computation

Abstract:Evolutionary algorithms often have to solve optimization problems in the presence of a wide range of uncertainties. Generally, uncertainties in evolutionary computation can be divided into the following four categories. First, the fitness function is noisy. Second, the design variables and/or the environmental parameters may change after optimization, and the quality of the obtained optimal solution should be robust against environmental changes or deviations from the optimal point. Third, the fitness function is approximated, which means that the fitness function suffers from approximation errors. Fourth, the optimum of the problem to be solved changes over time and, thus, the optimizer should be able to track the optimum continuously. In all these cases, additional measures must be taken so that evolutionary algorithms are still able to work satisfactorily. This paper attempts to provide a comprehensive overview of the related work within a unified framework, which has been scattered in a variety of research areas. Existing approaches to addressing different uncertainties are presented and discussed, and the relationship between the different categories of uncertainties are investigated. Finally, topics for future research are suggested.

Single/Multi-objective Inverse Robust Evolutionary Design Methodology in the Presence of Uncertainty

Inverse Multi-Objective Robust Evolutionary Design.

A Direct Coupled Solution Methodology for Efficient Robust Optimizations of Inverse Problems under Uncertainty

Multistage Robust Mixed-Integer Optimization under Endogenous Uncertainty

Simulation-Based Robust Design of Complex Product Considering Uncertainties of Metamodel, Design Variables, and Noise Parameters

A New Methodology for Robust Optimizations of Optimal Design Problems under Interval Uncertainty

Non-Probabilistic Robust Equilibrium Optimization of Complex Uncertain Structures

Robust Optimization Using a Methodology Based on Cross Entropy Methods

Heterogeneous-Objective Robust Optimization of Complex Mechatronic Components Considering Interval Uncertainties

Robust Optimization and Sensitivity Analysis with Multi-Objective Genetic Algorithms: Single- and Multi-Disciplinary Applications

A robust multi-objective Bayesian optimization framework considering input uncertainty

New Robust Optimization Approach Induced by Flexible Uncertainty Set: Optimization under Continuous Uncertainty

A New Hybrid Algorithm for Multi-Objective Robust Optimization with Interval Uncertainty

Trade-ofi between Optimality and Robustness: An Evolutionary Multiobjective Approach

Integrated multi-objective robust optimization and sensitivity analysis with irreducible and reducible interval uncertainty

Time-Dependent Reliability-Based Robust Design Optimization Using Evolutionary Algorithm

A Sequential Robust Optimization Approach for Multidisciplinary Design Optimization with Uncertainty

Trade-off Between Performance and Robustness: an Evolutionary Multiobjective Approach

Research on Multi-Objective Robust Design

ERGO: A New Robust Design Optimization Technique Combining Multi-Objective Bayesian Optimization With Analytical Uncertainty Quantification

Evolutionary Optimization in Uncertain Environments-a Survey