Abstract:The emergence of GPU-CPU heterogeneous architecture has led to a significant paradigm shift in parallel programming. How to effectively implement Parallel Genetic Algorithm (GA) in these environments has become one of the current hot issues. GA’s calculation and operators are closely related to specific problems, thereby significantly affecting the acceleration method of GA algorithms. The Generalized Assignment Problem (GAP) is a classic NP-hard combinatorial optimization problem. The more widely used genetic algorithms to solve the GAP in the CPU are difficult to be parallelized in a GPU environment due to severe data dependencies. To address this problem, two algorithms suitable for the implementation on the GPU are proposed, namely RPE algorithm and NNE algorithm, which obtain significant performance speedup by alleviating data dependencies and mutually exclusive synchronization overheads. At the same time, considering the new GPU architecture features and programming models, three different granular implementations of parallel genetic algorithms to solve the GAP are proposed, namely GPGAthread\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{thread}$$\end{document}, GPGAwarpsp\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{warpsp}$$\end{document} and GPGAcgroup\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\text{ GPGA}_{cgroup}$$\end{document}, by utilizing the warp-specialization technology and the cooperative group mechanism. GPGA series algorithms obtain better solution quality and very significant performance improvements compared with Serial GA, GTS (the GPU-CPU hybrid implementation of Scatter Search with Tabu lists) and Lagrange Relaxation algorithm on a CPU by solving 16 typical large-scale GAP instances.

Efficient Method for Histogram Generation on GPU

A parallel computing method for irregular work

A GPU Based Memory Optimized Parallel Method For FFT Implementation

GPU Lock-Free Hopscotch Hash Table

GPU-acceleration for Large-scale Tree Boosting

Exploiting Memory Access Patterns to Improve Memory Performance in Data-Parallel Architectures

GPU Memory Optimization Through Program Restructuring Methods

Performance Enhancement of GPU Parallel Computing Using Memory Allocation Optimization

A Configurable Parallel Hardware Architecture for Efficient Integral Histogram Image Computing.

Parallel Frequent Pattern Mining Without Candidate Generation on GPUs.

GPGPU Memory Estimation and Optimization Targeting OpenCL Architecture

Efficient Computation of Histograms on Densely Overlapped Polygonal Regions

In-memory Grid Files on Graphics Processors

Novel parallel hybrid genetic algorithms on the GPU for the generalized assignment problem

An Experimental GPU Global Memory Performance Estimation and Optimization

GPU Performance Optimization Targeting OpenCL Model

An Image Histogram Equalization Acceleration Method for Field-Programmable Gate Arrays Based on a Two-Dimensional Configurable Pipeline

High-performance code generation for stencil computations on GPU architectures

GAMMA: A Graph Pattern Mining Framework for Large Graphs on GPU.

Research and Implementation of Effective Jacobi Iteration Algorithms on GPU

Register and Thread Structure Optimization for GPUs