Hybrid Sine Cosine and Particle Swarm Optimization Algorithm for High-Dimensional Global Optimization Problem and Its Application

Huimin Wang,Yuelin Gao,Yahua He

DOI: https://doi.org/10.3390/math12070965

IF: 2.4

2024-03-25

Mathematics

Abstract:Particle Swarm Optimization (PSO) is facing more challenges in solving high-dimensional global optimization problems. In order to overcome this difficulty, this paper proposes a novel PSO variant of the hybrid Sine Cosine Algorithm (SCA) strategy, named Velocity Four Sine Cosine Particle Swarm Optimization (VFSCPSO). The introduction of the SCA strategy in the velocity formulation ensures that the global optimal solution is found accurately. It increases the flexibility of PSO. A series of experiments are conducted on the CEC2005 test suite with compositional algorithms, algorithmic variants, and good intelligent algorithms. The experimental results show that the algorithm effectively improves the overall performance of compositional algorithms; the Friedman test proves that the algorithm has good competitiveness. The algorithm also performs better in PID parameter tuning. Therefore, the VFSCPSO is able to solve the high-dimensional global optimization problems in a better way.

mathematics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenges in high - dimensional global optimization problems, especially the limitations of the Particle Swarm Optimization (PSO) algorithm when dealing with high - dimensional optimization problems. Specifically, the main difficulties that PSO faces when solving high - dimensional global optimization problems include:

1. **Slow convergence speed**: As the dimension increases, the search efficiency of PSO will decrease significantly, resulting in a slower convergence speed.
2. **Prone to fall into local optimal solutions**: In high - dimensional space, PSO is likely to converge prematurely to local optimal solutions and fail to find the global optimal solution.
3. **Imbalance between exploration and exploitation capabilities**: PSO has a strong exploration ability in the early stage, but its exploitation ability in the later stage is insufficient, leading to a decline in overall performance.

To overcome these difficulties, the paper proposes a new PSO variant - a hybrid algorithm based on the Sine Cosine Algorithm (SCA) strategy, called "Four - Sine - Cosine - Particle - Swarm - Optimization - Algorithm" (VFSCPSO). By introducing the SCA strategy, this algorithm aims to improve the performance of PSO in high - dimensional global optimization problems. The specific objectives include:

- **Improve global search ability**: By combining the exploration ability of SCA and the exploitation ability of PSO, the algorithm can search for the global optimal solution more effectively.
- **Enhance the flexibility of the algorithm**: After introducing the SCA strategy, the flexibility of the algorithm is improved, and it can show better adaptability in different optimization problems.
- **Avoid local optimal solutions**: By introducing the random search strategy of SCA, the algorithm can better jump out of local optimal solutions and improve the accuracy of global search.
- **Accelerate the convergence process**: By reasonably adjusting the parameters, the algorithm can accelerate the convergence speed while maintaining the global search ability.

In summary, the main purpose of this paper is to solve the problems of slow convergence speed, proneness to fall into local optimal solutions, and imbalance between exploration and exploitation capabilities of PSO in high - dimensional global optimization problems by proposing the VFSCPSO algorithm, thereby improving the overall performance and application range of the algorithm.