Abstract:The emergence of GPU-CPU heterogeneous architecture has led to a significant paradigm shift in parallel programming. How to effectively implement Parallel Genetic Algorithm (GA) in these environments has become one of the current hot issues. GA’s calculation and operators are closely related to specific problems, thereby significantly affecting the acceleration method of GA algorithms. The Generalized Assignment Problem (GAP) is a classic NP-hard combinatorial optimization problem. The more widely used genetic algorithms to solve the GAP in the CPU are difficult to be parallelized in a GPU environment due to severe data dependencies. To address this problem, two algorithms suitable for the implementation on the GPU are proposed, namely RPE algorithm and NNE algorithm, which obtain significant performance speedup by alleviating data dependencies and mutually exclusive synchronization overheads. At the same time, considering the new GPU architecture features and programming models, three different granular implementations of parallel genetic algorithms to solve the GAP are proposed, namely GPGAthread\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{thread}$$\end{document}, GPGAwarpsp\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{warpsp}$$\end{document} and GPGAcgroup\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{cgroup}$$\end{document}, by utilizing the warp-specialization technology and the cooperative group mechanism. GPGA series algorithms obtain better solution quality and very significant performance improvements compared with Serial GA, GTS (the GPU-CPU hybrid implementation of Scatter Search with Tabu lists) and Lagrange Relaxation algorithm on a CPU by solving 16 typical large-scale GAP instances.

An efficient GPU-based parallel tabu search algorithm for hardware/software co-design

Parallel Transient Stability-Constrained Optimal Power Flow Using GPU as Coprocessor.

RTGPU: Real-Time GPU Scheduling of Hard Deadline Parallel Tasks With Fine-Grain Utilization

Efficient GPU Spatial-Temporal Multitasking

Algorithmic aspects for functional partitioning and scheduling in hardware/software co-design

Novel parallel hybrid genetic algorithms on the GPU for the generalized assignment problem

Parallel L-BFGS-B Algorithm on GPU.

A Gpu-Based Parallel Fireworks Algorithm For Optimization

Locality-aware Thread Block Design in Single and Multi-GPU Graph Processing

Exploiting the Task-Pipelined Parallelism of Stream Programs on Many-Core GPUs.

Hybrid CPU-GPU scheduling and execution of tree traversals

Exploiting Parallelism in the Simulation of General Purpose Graphics Processing Unit Program

A hardware/software partitioning method based on graph convolution network

A Compiler-assisted Locality Aware CTA Mapping Scheme

An Effective Heuristic-Based Approach for Partitioning.

Orchestrating Cache Management and Memory Scheduling for GPGPU Applications.

SPGPU: Spatially Programmed GPU

Multipopulation Genetic Algorithm Based on GPU for Solving TSP Problem

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps

Parallel Genetic Algorithms on Multiple FPGAs.

Accelerating Static Timing Analysis Using CPU-GPU Heterogeneous Parallelism