Abstract:The particle swarm optimization (PSO) algorithm has been one of the most effective methods for solving various engineering optimization problems. Most existing PSO variants frequently use fixed operators, the adoption of a fixed operator learning mode may restrict the intelligence level of each particle, thus reducing the performance of PSO in solving optimization issues with complicated fitness landscapes. To address single goal real-parameter numerical optimization while overcoming the above shortcoming, this paper proposes a reinforcement learning-based particle swarm optimization with neighborhood differential mutation strategy (NRLPSO). In NRLPSO, a dynamic oscillation inertial weight (DOW) strategy that provides particles with dynamic adjustment ability in different situations is designed. To resolve the operator selection conundrum of exploration and exploitation, a reinforcement learning-based velocity vector generation (VRL) strategy is developed. At each iteration, particles select the velocity update model based on reinforcement learning, and VRL helps to thoroughly search the problem space. A velocity updating mechanism based on cosine similarity (VCS) is applied to control the velocity learning mode to determine more promising solutions. Furthermore, to alleviate the problem of premature convergence, a local update strategy with neighborhood differential mutation (NDM) is employed to increase the diversity of the algorithm. To verify the efficiency of the proposed algorithm, the CEC2017 and CEC2022 test suites are implemented, and nine classic or state-of-the-art PSO variants are comprehensively tested.The experimental results show that NRLPSO outperforms the popular PSO variants in terms of convergence speed and accuracy. Since NRLPSO utilizes the DE mutations, it is compared with the representative LSHADE variant algorithm - LSHADE_SPACMA. Although LSHADE_SPACMA is better than NRLPSO concerning algorithm stability and convergence accuracy, we will refine our work in the future to enhance the performance in all aspects.

Research on Neural Networks Learning Algorithm Based on Pso and Coa

Ant Algorithm Based Optimization Of Neural Network Model Of Water Distribution System

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Cooperative Bare-Bone Particle Swarm Optimization for Data Clustering

Neural Networks Learning Using Vbest Model Particle Swarm Optimisation

A New Hybrid Genetic Algorithm Based On Chaos And Pso

A Study of Application of An Improved PSO Algorithm in BP Network

Pruning strategy based bare bones particle swarm optimization

A Modified Particle Swarm Optimization Algorithm for Global Optimizations of Inverse Problems

A BP Neural Network Prediction Method Based on Particle Swarm Optimization and Its Application

Designing neural networks using hybrid particle swarm optimization

Designing Neural Networks Using PSO-Based Memetic Algorithm

Improved PSO Algorithm Integrated With Opposition-Based Learning and Tentative Perception in Networked Data Centres

Global-best optimization of ANN trained by PSO using the non-extensive cross-entropy with Gaussian gain

A Cooperative Approach to Particle Swarm Optimization

psoResNet: an Improved PSO-Based Residual Network Search Algorithm

Learning Bayesian Networks from Data by Particle Swarm Optimization

Research on hybrid strategy Particle Swarm Optimization algorithm and its applications

APSO-SL: An Adaptive Particle Swarm Optimization with State-Based Learning Strategy

In-Depth Case Study on Artificial Neural Network Weights Optimization Using Meta-Heuristic and Heuristic Algorithmic Approach

Reinforcement learning-based particle swarm optimization with neighborhood differential mutation strategy