Abstract:The emergence of GPU-CPU heterogeneous architecture has led to a significant paradigm shift in parallel programming. How to effectively implement Parallel Genetic Algorithm (GA) in these environments has become one of the current hot issues. GA’s calculation and operators are closely related to specific problems, thereby significantly affecting the acceleration method of GA algorithms. The Generalized Assignment Problem (GAP) is a classic NP-hard combinatorial optimization problem. The more widely used genetic algorithms to solve the GAP in the CPU are difficult to be parallelized in a GPU environment due to severe data dependencies. To address this problem, two algorithms suitable for the implementation on the GPU are proposed, namely RPE algorithm and NNE algorithm, which obtain significant performance speedup by alleviating data dependencies and mutually exclusive synchronization overheads. At the same time, considering the new GPU architecture features and programming models, three different granular implementations of parallel genetic algorithms to solve the GAP are proposed, namely GPGAthread\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{thread}$$\end{document}, GPGAwarpsp\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{warpsp}$$\end{document} and GPGAcgroup\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{cgroup}$$\end{document}, by utilizing the warp-specialization technology and the cooperative group mechanism. GPGA series algorithms obtain better solution quality and very significant performance improvements compared with Serial GA, GTS (the GPU-CPU hybrid implementation of Scatter Search with Tabu lists) and Lagrange Relaxation algorithm on a CPU by solving 16 typical large-scale GAP instances.

Parallel Particle Swarm Optimization Algorithm Based On Graphic Processing Units

GPU-based parallel particle swarm optimization

cuPSO: GPU Parallelization for Particle Swarm Optimization Algorithms

GPU-based parallel multi-objective particle swarm optimization

Implementation of the moving particle semi-implicit method for free-surface flows on GPU clusters.

The Implementation of the Three-Dimensional Unified Gas-Kinetic Wave-Particle Method on Multiple Graphics Processing Units

A Gpu-Based Parallel Fireworks Algorithm For Optimization

Particle swarm optimization with triggered mutation and its implementation based on GPU.

Parallel asynchronous particle swarm optimization

Parallel hybrid PSO with CUDA for lD heat conduction equation

Parallel Implementations of the Cooperative Particle Swarm Optimization on Many-core and Multi-core Architectures

Implementation and testing of parallel PSO to attain speedup on general purpose computer systems

Parallel Transient Stability-Constrained Optimal Power Flow Using GPU as Coprocessor.

An Approach for Low-power Heterogeneous Parallel Implementation of ALC-PSO Algorithm using OmpSs and CUDA

Study of A Gpu-Based Parallel Computing Method for the Monte Carlo Program

Parallel fish swarm algorithm based on GPU-acceleration

Multi-swarm particle swarm optimization based on CUDA for sparse reconstruction

Novel parallel hybrid genetic algorithms on the GPU for the generalized assignment problem

Parallel L-BFGS-B Algorithm on GPU.

A parallel implementation of nearest neighbor analysis based on GPGPU

GPU Parallel Computing: Programming Language, Debugging Tools and Data Structures