Abstract:The emergence of GPU-CPU heterogeneous architecture has led to a significant paradigm shift in parallel programming. How to effectively implement Parallel Genetic Algorithm (GA) in these environments has become one of the current hot issues. GA’s calculation and operators are closely related to specific problems, thereby significantly affecting the acceleration method of GA algorithms. The Generalized Assignment Problem (GAP) is a classic NP-hard combinatorial optimization problem. The more widely used genetic algorithms to solve the GAP in the CPU are difficult to be parallelized in a GPU environment due to severe data dependencies. To address this problem, two algorithms suitable for the implementation on the GPU are proposed, namely RPE algorithm and NNE algorithm, which obtain significant performance speedup by alleviating data dependencies and mutually exclusive synchronization overheads. At the same time, considering the new GPU architecture features and programming models, three different granular implementations of parallel genetic algorithms to solve the GAP are proposed, namely GPGAthread\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{thread}$$\end{document}, GPGAwarpsp\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{warpsp}$$\end{document} and GPGAcgroup\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{cgroup}$$\end{document}, by utilizing the warp-specialization technology and the cooperative group mechanism. GPGA series algorithms obtain better solution quality and very significant performance improvements compared with Serial GA, GTS (the GPU-CPU hybrid implementation of Scatter Search with Tabu lists) and Lagrange Relaxation algorithm on a CPU by solving 16 typical large-scale GAP instances.

Research and Implementation of Effective Jacobi Iteration Algorithms on GPU

A parallel computing method for irregular work

Matrix Decomposition Graphics Processing Unit Solver for Poisson Image Editing

Hierarchical Jacobi Iteration for Structured Matrices on GPUs using Shared Memory

Efficient Same-Dimensional Implicit Time Advancement Parallel Scheme and Optimization Methods for the Iteration Parameters Using a Graphics-Processing Unit

Parallel Implementations of the Jacobi Linear Algebraic Systems Solve

A New Parallel Gauss-Seidel Method by Iteration Space Alternate Tiling

Parallel L-BFGS-B Algorithm on GPU.

Jacobi solver: A fast FPGA-based engine system for Jacobi method

GPU-based Parallel Solver Via the Kantorovich Theorem for the Nonlinear Bernstein Polynomial Systems.

Accelerating Lattice QCD Simulations using GPUs

A GPU-accelerated Cartesian grid method for PDEs on irregular domain

Novel parallel hybrid genetic algorithms on the GPU for the generalized assignment problem

Real-time 3-D image analysis via Jacobi moments

GPU-Acceleration of Parallel Unconditionally Stable Group Explicit Finite Difference Method

A Cache-Efficient Parallel Gauss-Seidel Solver with Alternating Tiling

Parallel Triangular Solvers on GPU

Parallel GPU Implementation of Iterative PCA Algorithms

Iterative Methods in GPU-Resident Linear Solvers for Nonlinear Constrained Optimization

Parallel Monte Carlo Integration Algorithm Based on GPU

Parallel Processing on Block-Based Gauss-Jordan Algorithm for Desktop Grid.