Abstract:Designing convolutional neural network (CNN) accelerators is getting more difficult owing to the fast-increasing types of CNN models. Some approaches use constant dataflow and microarchitecture that have lower design complexity. However, these accelerators are difficult to adapt with the highly-diverse CNN models and often suffer from low process element utilization. Some other accelerators resort to reconfigurable devices, such as field-programmable gate array (FPGA) and coarse-grained reconfigurable array to support flexible dataflows in order to fit diverse CNN layers. However, layer-by-layer processing may require more energy for frequent reconfiguration and off-chip DDR access. In this work, we introduce a reconfigurable pipeline accelerator (RPA) that can reduce the latency and DDR access by pipelining the compuptation of CNN layers. Although there have been several researches that try to speedup the design process by automatically exploring subset of the accelerator design space, identifying an available automated design tool that can effectively find the complete and optimal design scheme remains a problem, especially for the novel RPA architecture type. Unfortunately, comprehensive exploration of the whole design space faces an excessive large searching space. To tackle this problem, we propose REMAP, a toolkit for designing CNN accelerators based on the Monte Carlo tree search (MCTS) method. To efficiently search the huge design space, we propose several methods to improve searching efficiency. Evaluations show that REMAP significantly outperforms some state-of-the-art approaches; compared with GAMMA, it achieves an average speed increase of $14.75\times $ , and an energy reduction of 45.45%; it also achieves a speed increase of $32.6\times $ against ConfuciuX on MobileNetV2 and ResNet50. We also show an FPGA accelerator implementation which is based on REMAP’s search result, and it achieves high performance in real-time CNN tasks. This indicates that REMAP can provide high-quality design exploration with valuable insights and useful architecture design guidances.

A Convolution Neural Network Accelerator Design with Weight Mapping and Pipeline Optimization

MLCNN: Cross-Layer Cooperative Optimization and Accelerator Architecture for Speeding Up Deep Learning Applications

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Pipeline Design of Nonvolatile-based Computing in Memory for Convolutional Neural Networks Inference Accelerators

Optimizing Convolutional Neural Networks on Multi-Core Vector Accelerator

A High-Performance Pixel-Level Fully Pipelined Hardware Accelerator for Neural Networks

Optimizing of Convolutional Neural Network Accelerator

Optimizing CNN Hardware Acceleration with Configurable Vector Units and Feature Layout Strategies

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

Design of a Convolutional Neural Network Accelerator Based on On-Chip Data Reordering

A High Efficient Architecture for Convolution Neural Network Accelerator

A Parallel Loading Based Accelerator for Convolution Neural Network

A Weight Mapping Strategy for More Fully Exploiting Data in CIM-Based CNN Accelerator

An Efficient Accelerator for Multiple Convolutions From the Sparsity Perspective

REMAP: A Spatiotemporal CNN Accelerator Optimization Methodology and Toolkit Thereof

Optimizing the Convolution Operation to Accelerate Deep Neural Networks on FPGA

Accelerating CNN Training With Concurrent Execution of GPU and Processing-in-Memory

ACCDSE: A Design Space Exploration Framework for Convolutional Neural Network Accelerator.

A High-Throughput FPGA Accelerator for Lightweight CNNs With Balanced Dataflow

A Reconfigurable Accelerator for Sparse Convolutional Neural Networks.

VWA: Hardware Efficient Vectorwise Accelerator for Convolutional Neural Network