Abstract:<p>The astonishing development in the field of artificial neural networks (ANN) has brought significant advancement in many application domains, such as pattern recognition, image classification, and computer vision. ANN imitates neuron behaviors and makes a decision or prediction by learning patterns and features from the given data set. To reach higher accuracies, neural networks are getting deeper, and consequently, the computation and storage demands on hardware platforms are steadily increasing. In addition, the massive data communication among neurons makes the interconnection more complex and challenging. To overcome these challenges, ASIC-based DNN accelerators are being designed which usually incorporate customized processing elements, fixed interconnection, and large off-chip memory storage. As a result, DNN computation involves large memory accesses due to frequent load/off-loading data, which significantly increases the energy consumption and latency. Also, the rigid architecture and interconnection among processing elements limit the efficiency of the platform to specific applications. In recent years, Network-on-Chip-based (NoC-based) DNN becomes an emerging design paradigm because the NoC interconnection can help to reduce the off-chip memory accesses while offers better scalability and flexibility. To evaluate the NoC-based DNN in the early design stage, we introduce a cycle-accurate NoC-based DNN simulator, called DNNoC-sim. To support various operations such as convolution and pooling in the modern DNN models, we first propose a DNN flattening technique to convert diverse DNN operation into MAC-like operations. In addition, we propose a DNN slicing method to evaluate the large-scale DNN models on a resource-constraint NoC platform. The evaluation results show a significant reduction in the off-chip memory accesses compared to the state-of-the-art DNN model. We also analyze the performance and discuss the trade-off between different design parameters.</p>

AFNFA: an Approach to Automate NCCL Configuration Exploration.

Splicing Process Inspired Cuckoo Search Algorithm Based ENNs for Modeling FCCU Reactor-Regenerator System

PreConfig: A Pretrained Model for Automating Network Configuration

FL-AGCNS: Federated Learning Framework for Automatic Graph Convolutional Network Search

Automatic Generation and Optimization Framework of NoC-Based Neural Network Accelerator Through Reinforcement Learning

Nnscaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training.

AOME: Autonomous Optimal Mapping Exploration Using Reinforcement Learning for NoC-based Accelerators Running Neural Networks

NAF: Deeper Network/Accelerator Co-Exploration for Customizing CNNs on FPGA

AutoFCL: Automatically Tuning Fully Connected Layers for Handling Small Dataset

Instance-Conditioned Adaptation for Large-scale Generalization of Neural Combinatorial Optimization

Centrality-Based Node Feature Augmentation for Robust Network Alignment

Unleashing Network/Accelerator Co-Exploration Potential on FPGAs: A Deeper Joint Search

NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals

Automatic Organization of Neural Modules for Enhanced Collaboration in Neural Networks

MFENAS

Towards a Dynamic Future with Adaptable Computing and Network Convergence (ACNC)

COAC: Cross-layer Optimization of Accelerator Configurability for Efficient CNN Processing

Automating Neural Architecture Design without Search

NAAS: Neural Accelerator Architecture Search

Developing an advanced neural network and physics solver coupled framework for accelerating flow field simulations

A NoC-based simulator for design and evaluation of deep neural networks