Abstract:Object detection via deep neural networks has undergone considerable advancements in recent years. Yet, the detection of smaller objects, specifically those with a few pixels (i.e., < 322 pixels), is still challenging compared with large objects (i.e., > 962 pixels). Existing methods commonly apply high-resolution features or complex super-resolution strategies based on the two-stage Faster Region Convolutional Neural Network (RCNN). They sequentially apply localization and classification stages after a shared feature map extracted by one single backbone network. However, these methods cause low detection accuracy of small objects, high computational overhead, and waste of hardware resources. In this paper, we develop a high-accuracy and real-time small object detection system with negligible computational overhead and low hardware idleness. At the software level, we propose a two-stage Coarse-to-Fine Decoupling RCNN (CFD RCNN) with three techniques: (1) The shared backbone decoupling for localization and classification to achieve high accuracy for both tasks; (2) The training method using backbone feature upsampling for localization with low computational overhead; (3) The object cropping strategy from the original high-resolution image for high-accuracy classification. At the hardware level, we propose a virtualized FPGA accelerator with the Dynamic Resource Allocation (DRA) strategy. The DRA strategy reallocates the hardware resources, considering the workload and resource preference of each stage in CFD RCNN to reduce hardware idleness. Extensive experiments on the TT100K and GTSDB datasets using Xilinx ZCU102 FPGA show that the proposed small object detection system can achieve 2.9% improvement in mean average precision (mAP) compared with state-of-the-art (SOTA) algorithms and raised the throughput from 18.9 FPS to > 26.0 FPS (~1.37×) compared with existing accelerators.

Resource- and Power-Efficient High-Performance Object Detection Inference Acceleration Using FPGA

FPGA-based Object Detection Acceleration Architecture Design

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

Hardware Acceleration for Object Detection using YOLOv5 Deep Learning Algorithm on Xilinx Zynq FPGA Platform

A dedicated hardware accelerator for real-time acceleration of YOLOv2

WGeod: A General and Efficient FPGA Accelerator for Object Detection

Design and implementation of FPGA-based deep learning object detection system

Reduced-Parameter YOLO-Like Object Detector Oriented to Resource-Constrained Platform

An FPGA-Based YOLOv5 Accelerator for Real-Time Industrial Vision Applications

An FPGA Accelerator Design of Spiking Neural Network for Energy-Efficient Object Detection

A High-Performance YOLOV5 Accelerator for Object Detection with Near Sensor Intelligence.

Object Detection Edge Performance Optimization on FPGA-Based Heterogeneous Multiprocessor Systems

System Integration and Optimization of AI Hardware Acceleration Architecture for Object Detection

FPGA-Based Hardware Accelerator Design and Implementation of Oil Palm Detection

An Efficient Real-Time Object Detection Framework on Resource-Constricted Hardware Devices via Software and Hardware Co-design

Hardware Acceleration and Implementation of YOLOX-s for On-Orbit FPGA

Algorithm-Hardware Co-Optimization for Energy-Efficient Drone Detection on Resource-Constrained FPGA

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

YOLOv2 acceleration using embedded GPU and FPGAs: pros, cons, and a hybrid method

Towards High-accuracy and Real-time Two-stage Small Object Detection on FPGA

Edge Real-Time Object Detection and DPU-Based Hardware Implementation for Optical Remote Sensing Images