Abstract:Brain simulation is one of the most important measures to understand how information is represented and processed in the brain, which usually needs to be realized in supercomputers with a large number of interconnected graphical processing units (GPUs). For the whole human brain simulation, tens of thousands of GPUs are utilized to simulate tens of billions of neurons and tens of trillions of synapses for the living brain to reveal functional connectivity patterns. However, as an application of the irregular spares communication problem on a large-scale system, the sparse and imbalanced communication patterns of the human brain make it particularly challenging to design a communication system for supporting large-scale brain simulations. To face this challenge, this paper proposes a hierarchical regularized communication mechanism, HRCM. The HRCM maintains a hierarchical virtual communication topology (HVCT) with a merge-forward algorithm that exploits the sparsity of neuron interactions to regularize inter-process communications in brain simulations. HRCM also provides a neuron-level partition scheme for assigning neurons to simulation processes to balance the communication load while improving resource utilization. In HRCM, neuron partition is formulated as a k-way graph partition problem and solved efficiently by the proposed hybrid multi-constraint greedy (HMCG) algorithm. HRCM has been implemented in human brain simulations at the scale of up to 86 billion neurons running on 10000 GPUs. Results obtained from extensive simulation experiments verify the effectiveness of HRCM in significantly reducing communication delay, increasing resource usage, and shortening simulation time for large-scale human brain models.

Efficient communication approach in HLA-based distributed simulation for VR application

A scalable HLA-based distributed simulation framework for VR application

Tile-based Proactive Virtual Reality Streaming Via Online Hierarchial Learning

HIVE: a Highly Scalable Framework for DVE

Building High Performance DVR Via HLA, Scene Graph and Parallel Rendering.

Developing a Scalable Distributed Simulation on HIVE

Communication Model for Internet-Oriented 2.5D Virtual Environments

An Effective Communication Architecture for Collaborative Virtual Systems

Research on Unified Object Model Supporting HLA-based Simulation and Parallel Rendering.

Researching of HLA-based collaborative simulation intelligent evaluation system

HRCM: A Hierarchical Regularizing Mechanism for Sparse and Imbalanced Communication in Whole Human Brain Simulations

Research on Simulation System for Ship Transport Operation Based on HLA

Research on Multi-disciplinary Modeling Based on HLA

A Low-Latency Communication Design for Brain Simulations

Regularizing Sparse and Imbalanced Communications for Voxel-based Brain Simulations on Supercomputers

An HLA-based distributed object-oriented simulation engine

Integrating Web Services Technology to Hla-Based Multidisciplinary Collaborative Simulation System for Complex Product Development

On HLA-Based Collaborative Simulation Techniques.

Immersive Virtual Simulation System for Principles of Communications Based on Unity 3D

An Architecture And Implementation Of Simulation Grid Rtp