Abstract:Vector Accelerators have been widely used in scientific computing. It also shows great potential to accelerate the computational performance of convolutional neural networks (CNNs). However, previous general CNN-mapping methods introduced a large amount of intermediate data and additional conversion, and the resulting memory overhead would cause great performance loss. To address these issues and achieve high computational efficiency, this paper proposes an efficient CNNmapping method dedicated to vector accelerators, including: 1) Data layout method: establishing a set of efficient data storage and computing models for various CNN networks on vector accelerators. It achieves high memory access efficiency and high vectorization efficiency. 2) A conversion method: convert the computation of convolutional layers and fully connected layers into large-scale matrix multiplication, and convert the computation of pooling layers into row computation of matrix. All conversions are implemented by extracting rows from a two-dimensional matrix, with high data access and transmission efficiency, and without additional memory overhead and data conversion. Based on these methods, we design a vectorization mechanism to vectorize convolutional, pooling and fully connected layers on a vector accelerator, which can be applied for various CNN models. This mechanism takes full advantage of the parallel computing capability of the multi-core vector accelerator and further improves the performance of deep convolutional neural networks. The experimental results show that the average computational efficiency of the convolutional layers and full connected layers of AlexNet, VGG-19, GoogleNet and ResNet-50 is 93.3% and 93.4% respectively, and the average data access efficiency of pooling layer is 70%. Compared to NVIDIA inference GPUs, our accelerator achieves a 36.1% performance improvement, comparable to NVIDIA V100 GPUs. Compared with Matrix2000 of similar architecture, our accelerator achieves a 17-45% improvement in computational efficiency.

CNN-DMA: A Predictable and Scalable Direct Memory Access Engine for Convolutional Neural Network with Sliding-window Filtering.

DaDianNao: A Machine-Learning Supercomputer

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Accelerate Convolutional Neural Network With A Customized Vliw Dsp

Design of a Convolutional Neural Network Accelerator Based on On-Chip Data Reordering

Memory optimization of CNN Heterogeneous Multi-Core Architecture

An Enhanced Data Cache with In-Cache Processing Units for Convolutional Neural Network Accelerators

Optimizing Convolutional Neural Networks on Multi-Core Vector Accelerator

DWMAcc: Accelerating Shift-based CNNs with Domain Wall Memories

Runtime Support for Accelerating CNN Models on Digital DRAM Processing-in-Memory Hardware

CMDS: Cross-layer Dataflow Optimization for DNN Accelerators Exploiting Multi-bank Memories

Compressing DMA Engine: Leveraging Activation Sparsity for Training Deep Neural Networks

A High Efficient Architecture for Convolution Neural Network Accelerator

Optimizing CNN Hardware Acceleration with Configurable Vector Units and Feature Layout Strategies

PENDRAM: Enabling High-Performance and Energy-Efficient Processing of Deep Neural Networks through a Generalized DRAM Data Mapping Policy

Communication Minimized Model-Architecture Co-design for Efficient Convolution Acceleration

Memory-Computing Decoupling: A DNN Multitasking Accelerator with Adaptive Data Arrangement.

Memory Bandwidth and Energy Efficiency Optimization of Deep Convolutional Neural Network Accelerators.

DSA-CNN: an fpga-integrated deformable systolic array for convolutional neural network acceleration

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks