Abstract:The rapidly growing popularity and scale of data-parallel workloads demand a corresponding increase in raw computational power of GPUs (Graphics Processing Units). As single-GPU systems struggle to satisfy the performance demands, multi-GPU systems have begun to dominate the high-performance computing world. The advent of such systems raises a number of design challenges, including the GPU microarchitecture, multi-GPU interconnect fabrics, runtime libraries and associated programming models. The research community currently lacks a publically available and comprehensive multi-GPU simulation framework and benchmark suite to evaluate multi-GPU system design solutions. In this work, we present MGSim, a cycle-accurate, extensively validated, multi-GPU simulator, based on AMD's Graphics Core Next 3 (GCN3) instruction set architecture. We complement MGSim with MGMark, a suite of multi-GPU workloads that explores multi-GPU collaborative execution patterns. Our simulator is scalable and comes with in-built support for multi-threaded execution to enable fast and efficient simulations. In terms of performance accuracy, MGSim differs $5.5\%$ on average when compared against actual GPU hardware. We also achieve a $3.5\times$ and a $2.5\times$ average speedup in function emulation and architectural simulation with 4 CPU cores, while delivering the same accuracy as the serial simulation. We illustrate the novel simulation capabilities provided by our simulator through a case study exploring programming models based on a unified multi-GPU system (U-MGPU) and a discrete multi-GPU system (D-MGPU) that both utilize unified memory space and cross-GPU memory access. We evaluate the design implications from our case study, suggesting that D-MGPU is an attractive programming model for future multi-GPU systems.

Multiprocessor Simulator System Based on Multi-way Cluster Using Double-buffered Model

Distributed Memory Service Modeling in Multi-Processor Design

Evaluation and Design Trade-Offs Between Symmetric Shared-Memory and Distributed Shared-Memory

System-level Simulation Realization Based on Alpha Processor

System-Level Evaluation of Video Processing System Using SimpleScalar-Based Multi-core Processor Simulator

Simulation approach of hybrid optical-electrical on-chip interconnects for multicore systems

MCMG Simulator: A Unified Simulation Framework for CPU and Graphic GPU

The design of a cycle accurate multi-core architecture performance simulator

Exploring Performance of Shared-Bus-Based Multi-Processor System on a Chip

A Loosely-Coupled Full-System Multicore Simulation Framework

LINUX CLUSTER BASED POWER SYSTEM PARALLEL SIMULATION SYSTEM

Design Methodology of the Heterogeneous Multi-core Processor with the Combination of Parallelized Multi-core Simulator and Common Register File-Based Instruction Set Extension Architecture.

An 800mhz 320mw 16-Core Processor with Message-Passing and Shared-Memory Inter-Core Communication Mechanisms

An Accurate Multi-processing Simulator Based on ADL

Molecular Dynamics Simulation On Commodity Shared-Memory Multiprocessor Systems With Lightweight Multithreading

Architecture Design of a Single-chip Multiprocessor

Native Simulation of MPSoC Using Hardware-Assisted Virtualization.

A Simulation System and Algorithm Evaluation for Clustered Streaming Media Server

An Efficient Protocol with Synchronization Accelerator for Multi-Processor Embedded Systems

MGSim + MGMark: A Framework for Multi-GPU System Research

Design of Multiple Processor Communication Mechanism