Abstract:The particle swarm optimization (PSO) algorithm has been one of the most effective methods for solving various engineering optimization problems. Most existing PSO variants frequently use fixed operators, the adoption of a fixed operator learning mode may restrict the intelligence level of each particle, thus reducing the performance of PSO in solving optimization issues with complicated fitness landscapes. To address single goal real-parameter numerical optimization while overcoming the above shortcoming, this paper proposes a reinforcement learning-based particle swarm optimization with neighborhood differential mutation strategy (NRLPSO). In NRLPSO, a dynamic oscillation inertial weight (DOW) strategy that provides particles with dynamic adjustment ability in different situations is designed. To resolve the operator selection conundrum of exploration and exploitation, a reinforcement learning-based velocity vector generation (VRL) strategy is developed. At each iteration, particles select the velocity update model based on reinforcement learning, and VRL helps to thoroughly search the problem space. A velocity updating mechanism based on cosine similarity (VCS) is applied to control the velocity learning mode to determine more promising solutions. Furthermore, to alleviate the problem of premature convergence, a local update strategy with neighborhood differential mutation (NDM) is employed to increase the diversity of the algorithm. To verify the efficiency of the proposed algorithm, the CEC2017 and CEC2022 test suites are implemented, and nine classic or state-of-the-art PSO variants are comprehensively tested.The experimental results show that NRLPSO outperforms the popular PSO variants in terms of convergence speed and accuracy. Since NRLPSO utilizes the DE mutations, it is compared with the representative LSHADE variant algorithm - LSHADE_SPACMA. Although LSHADE_SPACMA is better than NRLPSO concerning algorithm stability and convergence accuracy, we will refine our work in the future to enhance the performance in all aspects.

A New PSO Algorithm with Random C/D Switchings

A Modified Particle Swarm Optimizer With A Novel Operator

A Method of Parameter Optimization for Particle Swarm Optimization Based on Stochastic Processes

Optimal Control Vector Parameterization Approach with A Hybrid Intelligent Algorithm for Nonlinear Chemical Dynamic Optimization Problems

Enhancing Particle Swarm Optimization via probabilistic models

Random drift particle swarm optimization algorithm: convergence analysis and parameter selection

A Dynamic Neighborhood-Based Switching Particle Swarm Optimization Algorithm

A Modified Particle Swarm Optimization Algorithm for Global Optimizations of Inverse Problems

An Improved Convergence Particle Swarm Optimization Algorithm with Random Sampling of Control Parameters

A stochastic scattering particle swarm optimizer

Effects of Random Values for Particle Swarm Optimization Algorithm

Random convergence analysis of particle swarm optimization algorithm with time‐varying attractor

A Quantum-Based Particle Swarm Optimization Algorithm Applied to Inverse Problems

A Modified PSO Algorithm with Dynamic Parameters for Solving Complex Engineering Design Problem

A convergence and diversity guided leader selection strategy for many-objective particle swarm optimization

Analyzing Convergence and Rates of Convergence of Particle Swarm Optimization Algorithms Using Stochastic Approximation Methods

A Rapid Particle Swarm Optimization Algorithm with Convergence Analysis

A Dual-Channel Particle Swarm Optimization Algorithm Based on Adaptive Balance Search

A Dual-Competition-Based Particle Swarm Optimizer for Large-Scale Optimization

Random Contrastive Interaction for Particle Swarm Optimization in High-Dimensional Environment

Reinforcement learning-based particle swarm optimization with neighborhood differential mutation strategy