Abstract:Constrained multi-objective optimization problems involve the optimization of multiple conflicting objectives simultaneously subject to a number of constraints, which pose a great challenge for the existing algorithms. When utilizing evolutionary algorithms to solve them, the constraint handling technique (CHT) plays a pivotal role in the environmental selection. Several CHTs, such as penalty functions, superiority of feasible solutions, and ϵ-constraint methods, have been developed. However, there are still some issues with the existing methods. On the one hand, different CHTs are typically better suited to specific problem and selecting the most appropriate CHT for a given problem is crucial. On the other hand, the suitability of CHTs may vary throughout different stages of the optimization process. Regrettably, limited attention has been given to the adaptive selection of CHTs. In order to address this research gap, we develop an adaptive CHT selection method based on deep reinforcement learning, allowing for the selection of CHTs that are tailored to different evolutionary states. In the proposed method, we adopt the deep Q-learning network to evaluate the impact of various CHTs and operators on the population state during evolution. Through a dynamic evaluation, the network adaptively outputs the most appropriate CHT and operator portfolio based on the current state of the population. Specifically, we propose novel state representation and reward calculation methods to accurately capture the performance of diverse actions across varying evolutionary states. Furthermore, to enhance network training, we introduce a two-stage training method that facilitates the collection of diverse samples. Moreover, this adaptive selection method can be easily integrated into the existing methods. The proposed algorithm is tested on 37 test problems, the optimal results can be achieved on 19 instances in terms of the inverted generational distance metric. Experimental results verify the proposed method generalizes well to different types of problems.

Using Generative Adversarial Networks for Efficient Constrained Multi-objective Optimization

An New Evolutionary Multi-Objective Optimization Algorithm

Growing Neural Gas Network for Offspring Generation in Evolutionary Constrained Multi-Objective Optimization

A Constrained Optimization Evolutionary Algorithm Based on Multiobjective Optimization Techniques

Evolutionary Multiobjective Optimization Driven by Generative Adversarial Networks (Gans)

Multi-objective and MGG evolutionary algorithm for constrained optimization

A Generative Adversarial Networks Model Based Evolutionary Algorithm for Multimodal Multi-Objective Optimization

Multiobjective Optimization and Adaptive Penalty Function Based Constrained Optimization Evolutionary Algorithm

An Improved Multi-Population Genetic Algorithm For Constrained Nonlinear Optimization

Adaptive Constraint Handling Technique Selection for Constrained Multi-Objective Optimization

A Surrogate-Assisted Offspring Generation Method for Expensive Multi-objective Optimization Problems

Offline Data-Driven Multi-objective Optimization Evolutionary Algorithm based on Generative Adversarial Network

Paired Offspring Generation for Constrained Large-Scale Multiobjective Optimization

A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization

Offline Data-Driven Multiobjective Optimization Evolutionary Algorithm Based on Generative Adversarial Network

Manifold-assisted coevolutionary algorithm for constrained multi-objective optimization

Balancing Objective Optimization and Constraint Satisfaction in Constrained Evolutionary Multiobjective Optimization

Manifold Interpolation for Large-Scale Multiobjective Optimization Via Generative Adversarial Networks

Multiobjective Optimization and Hybrid Evolutionary Algorithm to Solve Constrained Optimization Problems

Adaptive Offspring Generation for Evolutionary Large-Scale Multiobjective Optimization

An Adaptive Two-Population Evolutionary Algorithm for Constrained Multi-Objective Optimization Problems