Abstract:In recent years, Convolutional Neural Networks (CNNs) have been widely applied in computer vision and have achieved significant improvements in object detection tasks. Although there are many optimizing methods to speed up CNN-based detection algorithms, it is still difficult to deploy detection algorithms on real-time low-power systems. Field-Programmable Gate Array (FPGA) has been widely explored as a platform for accelerating CNN due to its promising performance, high energy efficiency, and flexibility. Previous works show that the energy consumption of CNN accelerators is dominated by the memory access. By fusing multiple layers in CNN, the intermediate data transfer can be reduced. However, previous accelerators with the cross-layer scheduling are designed for a particular CNN model. In addition to the memory access optimization, the Winograd algorithm can greatly improve the computational performance of convolution. In this article, to improve the flexibility of hardware, we design an instruction-driven CNN accelerator, supporting the Winograd algorithm and the cross-layer scheduling, for object detection. We modify the loop unrolling order of CNN, so that we can schedule a CNN across different layers with instructions and eliminate the intermediate data transfer. We propose a hardware architecture to support the instructions with Winograd computation units and reach the state-of-the-art energy efficiency. To deploy image detection algorithms onto the proposed accelerator with fixed-point computation units, we adopt the fixed-point fine-tune method, which can guarantee the accuracy of the detection algorithms. We evaluate our accelerator and scheduling policy on the Xilinx KU115 FPGA platform. The intermediate data transfer can be reduced by more than 90% on the VGG-D CNN model with the cross-layer strategy. Thus, the performance of our hardware accelerator reaches 1700GOP/s on the classification model VGG-D. We also implement a framework for object detection algorithms, which achieves 2.3× and 50× in energy efficiency compared with GPU and CPU, respectively. Compared with floating-point algorithms, the accuracy of the fixed-point detection algorithms only drops by less than 1%.

A 325 FPS Corner-Detection Accelerator with Hardware-Oriented Optimization.

SFTT: A 325 FPS Computational and Hardware Efficient Corner-Detection Accelerator Design for SLAM Applications

High-performance Subpixel Edge Location Based on FPGA for Horizon Sensors

Real-Time Visual Inertial Odometry with a Resource-Efficient Harris Corner Detection Accelerator on FPGA Platform

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

An ultra-fast and energy-efficient CNTFET-based image corner detection hardware for real-time image processing applications

Real Time FPGA Implementation of an Efficient High Speed Harris Corner Detection Algorithm Based on High-Level Synthesis

Efficient Hardware Accelerator Design of Non-Linear Optimization Correlative Scan Matching Algorithm in 2D LiDAR SLAM for Mobile Robots

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

An FPGA Based Energy Efficient DS-SLAM Accelerator for Mobile Robots in Dynamic Environment

A Target Corner Detection Algorithm Based on the Fusion of FAST and Harris

Hardware Acceleration for SLAM in Mobile Systems

An FPGA Acceleration and Optimization Techniques for 2D LiDAR SLAM Algorithm

Hardware Architecture for Fast General Object Detection using Aggregated Channel Features

Parallel and Pipelining design of SLAM Feature Detection Algorithm in Hardware

FPSNET: An Architecture for Neural-Network-Based Feature Point Extraction for SLAM

Instruction Driven Cross-layer CNN Accelerator for Fast Detection on FPGA

Memory Efficient Corner Detection for Event-driven Dynamic Vision Sensors

A Hardware Accelerator with Variable Pixel Representation & Skip Mode Prediction for Feature Point Detection Part of SIFT Algorithm.

An FPGA Accelerator for High-Speed Moving Objects Detection and Tracking With a Spike Camera

Efficient Hardware Post Processing of Anchor-Based Object Detection on FPGA