Abstract:Constrained multi-objective optimization problems involve the optimization of multiple conflicting objectives simultaneously subject to a number of constraints, which pose a great challenge for the existing algorithms. When utilizing evolutionary algorithms to solve them, the constraint handling technique (CHT) plays a pivotal role in the environmental selection. Several CHTs, such as penalty functions, superiority of feasible solutions, and ϵ-constraint methods, have been developed. However, there are still some issues with the existing methods. On the one hand, different CHTs are typically better suited to specific problem and selecting the most appropriate CHT for a given problem is crucial. On the other hand, the suitability of CHTs may vary throughout different stages of the optimization process. Regrettably, limited attention has been given to the adaptive selection of CHTs. In order to address this research gap, we develop an adaptive CHT selection method based on deep reinforcement learning, allowing for the selection of CHTs that are tailored to different evolutionary states. In the proposed method, we adopt the deep Q-learning network to evaluate the impact of various CHTs and operators on the population state during evolution. Through a dynamic evaluation, the network adaptively outputs the most appropriate CHT and operator portfolio based on the current state of the population. Specifically, we propose novel state representation and reward calculation methods to accurately capture the performance of diverse actions across varying evolutionary states. Furthermore, to enhance network training, we introduce a two-stage training method that facilitates the collection of diverse samples. Moreover, this adaptive selection method can be easily integrated into the existing methods. The proposed algorithm is tested on 37 test problems, the optimal results can be achieved on 19 instances in terms of the inverted generational distance metric. Experimental results verify the proposed method generalizes well to different types of problems.

Deep Reinforcement Learning Based Adaptive Operator Selection for Evolutionary Multi-Objective Optimization

Deep Reinforcement Learning Based Adaptive Environmental Selection for Evolutionary Multi-Objective Optimization.

Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection

Adaptive operator selection with dueling deep Q-network for evolutionary multi-objective optimization

Adaptive Constraint Handling Technique Selection for Constrained Multi-Objective Optimization

A decomposition-based multi-objective evolutionary algorithm with Q-learning for adaptive operator selection

A Novel Multi-State Reinforcement Learning-Based Multi-Objective Evolutionary Algorithm

An Evolutionary Algorithm Based on Multi-operator Ensemble for Multi-objective Optimization

A Reference Vector Based Multiobjective Evolutionary Algorithm with Q-learning for Operator Adaptation

Adaptive Composite Operator Selection and Parameter Control for Multiobjective Evolutionary Algorithm

Learning to select the recombination operator for derivative-free optimization

AdaBoost-inspired Multi-Operator Ensemble Strategy for Multi-Objective Evolutionary Algorithms

Dynamic Selection of Evolutionary Operators Based on Online Learning and Fitness Landscape Analysis

Adaptive Operator Selection with Bandits for A Multiobjective Evolutionary Algorithm Based on Decomposition

R2 Indicator and Deep Reinforcement Learning Enhanced Adaptive Multi-Objective Evolutionary Algorithm

Leader recommend operators selection strategy for a multiobjective evolutionary algorithm based on decomposition

Adaptive operator selection with test-and-apply structure for decomposition-based multi-objective optimization

Automated Selection of Evolutionary Multi-objective Optimization Algorithms.

A Multioperator Search Strategy Based on Cheap Surrogate Models for Evolutionary Optimization

Multi-Agent Reinforcement Learning with Asymmetric Representation Assisted by Multi-Objective Evolutionary Algorithms.

Large Language Model for Multi-objective Evolutionary Optimization