Abstract:The rapid evolution of Cloud-based services and the growing interest in deep learning (DL)-based applications is putting increasing pressure on hyperscalers and general purpose hardware designers to provide more efficient and scalable systems. Cloud-based infrastructures must consist of more energy efficient components. The evolution must take place from the core of the infrastructure (i.e., data centers (DCs)) to the edges (Edge computing) to adequately support new/future applications. Adaptability/elasticity is one of the features required to increase the performance-to-power ratios. Hardware-based mechanisms have been proposed to support system reconfiguration mostly at the processing elements level, while fewer studies have been carried out regarding scalable, modular interconnected sub-systems. In this paper, we propose a scalable Software Defined Network-on-Chip (SDNoC)-based architecture. Our solution can easily be adapted to support devices ranging from low-power computing nodes placed at the edge of the Cloud to high-performance many-core processors in the Cloud DCs, by leveraging on a modular design approach. The proposed design merges the benefits of hierarchical network-on-chip (NoC) topologies (via fusing the ring and the 2D-mesh topology), with those brought by dynamic reconfiguration (i.e., adaptation). Our proposed interconnect allows for creating different types of virtualised topologies aiming at serving different communication requirements and thus providing better resource partitioning (virtual tiles) for concurrent tasks. To further allow the software layer controlling and monitoring of the NoC subsystem, a few customised instructions supporting a data-driven program execution model (PXM) are added to the processing element's instruction set architecture (ISA). In general, the data-driven programming and execution models are suitable for supporting the DL applications. We also introduce a mechanism to map a high-level programming language embedding concurrent execution models into the basic functionalities offered by our SDNoC for easing the programming of the proposed system. In the reported experiments, we compared our lightweight reconfigurable architecture to a conventional flattened 2D-mesh interconnection subsystem. Results show that our design provides an increment of the data traffic throughput of 9.5% and a reduction of 2.2× of the average packet latency, compared to the flattened 2D-mesh topology connecting the same number of processing elements (PEs) (up to 1024 cores). Similarly, power and resource (on FPGA devices) consumption is also low, confirming good scalability of the proposed architecture.

Deep Reinforcement Learning Enabled Self-Configurable Networks-on-Chip for High-Performance and Energy-Efficient Computing Systems

An Efficient Algorithm for Mapping Deep Learning Applications on the NoC Architecture

Optimizing Routerless Network-on-Chip Designs: An Innovative Learning-Based Framework

Reinforcement Learning based Interconnection Routing for Adaptive Traffic Optimization

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Self-optimizing Two-layer Network-on-Chip Based on Dominant Network-Flow Adaption

HAS-RL: A Hierarchical Approximate Scheme Optimized with Reinforcement Learning for NoC-Based NN Accelerators

A Reinforcement Learning Framework with Region-Awareness and Shared Path Experience for Efficient Routing in Networks-on-Chip

Automatically Reconfigurable Optical Network for HPC System Based on Deep Reinforcement Learning

Implementing Reinforcement Learning Datacenter Congestion Control in NVIDIA NICs

Towards a Scalable Software Defined Network-on-Chip for Next Generation Cloud

Scalable NoC-based Neuromorphic Hardware Learning and Inference

A NoC-based simulator for design and evaluation of deep neural networks

Automatic Generation and Optimization Framework of NoC-Based Neural Network Accelerator Through Reinforcement Learning

A deep learning based latency aware predictive routing model for network‐on‐chip architectures

Network Aware Compute and Memory Allocation in Optically Composable Data Centres with Deep Reinforcement Learning and Graph Neural Networks

Designing, Developing, and Validating Network Intelligence for Scaling in Service-Based Architectures based on Deep Reinforcement Learning

Medium Access using Distributed Reinforcement Learning for IoTs with Low-Complexity Wireless Transceivers

Core Placement Optimization for Multi-chip Many-core Neural Network Systems with Reinforcement Learning.

CAFEEN: A Cooperative Approach for Energy Efficient NoCs with Multi-Agent Reinforcement Learning

Machine Learning-based Low Overhead Congestion Control Algorithm for Industrial NoCs