Abstract:Deep convolutional neural networks (DNNs) have been widely used in many applications, particularly in machine vision. It is challenging to accelerate DNNs on embedded systems because real-world machine vision applications should reserve a lot of external memory bandwidth for other tasks, such as video capture and display, while leaving little bandwidth for accelerating DNNs. In order to solve this issue, in this study, we propose a high-throughput accelerator, called reconfigurable tiny neural network accelerator (ReTiNNA), for the bandwidth-limited system and present a real-time object detection system for the high-resolution video image. We first present a dedicated computation engine that takes different data mapping methods for various filter types to improve data reuse and reduce hardware resources. We then propose an adaptive layer-wise tiling strategy that tiles the feature maps into strips to reduce the control complexity of data transmission dramatically and to improve the efficiency of data transmission. Finally, a design space exploration (DSE) approach is presented to explore design space more accurately in the case of insufficient bandwidth to improve the performance of the low-bandwidth accelerator. With a low bandwidth of 2.23 GB/s and a low hardware consumption of 90.261K LUTs and 448 DSPs, ReTiNNA can still achieve a high performance of 155.86 GOPS on VGG16 and 68.20 GOPS on ResNet50, which is better than other state-of-the-art designs implemented on FPGA devices. Furthermore, the real-time object detection system can achieve a high object detection speed of 19 fps for high-resolution video.

A convolutional neural network accelerator for real-time underwater image recognition of autonomous underwater vehicle

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

DaDianNao: A Machine-Learning Supercomputer

Neural Network Acceleration and Voice Recognition with a Flash-based In-Memory Computing SoC

Efficient Hardware Optimization Strategies For Deep Neural Networks Acceleration Chip

A Real-Time FPGA Accelerator Based on Winograd Algorithm for Underwater Object Detection

A 3D Tiled Low Power Accelerator for Convolutional Neural Network

Real-Time Underwater Image Recognition with FPGA Embedded System for Convolutional Neural Network.

A Streaming Accelerator for Deep Convolutional Neural Networks with Image and Feature Decomposition for Resource-limited System Applications.

A Reconfigurable Streaming Deep Convolutional Neural Network Accelerator for Internet of Things

Small Area Configurable Deep Neural Network Accelerator for IoT System

N-AquaRAM: A Cost-Efficient Deep Learning Accelerator for Real-Time Aquaponic Monitoring

A Small-Footprint Accelerator for Large-Scale Neural Networks

Convolutional Neural Network Accelerator Architecture Design for Ultimate Edge Computing Scenario

An FPGA-Based Resource-Saving Hardware Accelerator for Deep Neural Network

An Embedded Tracking System With Neural Network Accelerator

A 40nm 2TOPS/W Depth-Completion Neural Network Accelerator SoC With Efficient Depth Engine for Realtime LiDAR Systems

A Reconfigurable Convolutional Neural Network-Accelerated Coprocessor Based on RISC-V Instruction Set

Design of a Convolutional Neural Network Accelerator Based on On-Chip Data Reordering

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

Real-time convolutional networks for sonar image classification in low-power embedded systems