Abstract:Object detection via deep neural networks has undergone considerable advancements in recent years. Yet, the detection of smaller objects, specifically those with a few pixels (i.e., < 322 pixels), is still challenging compared with large objects (i.e., > 962 pixels). Existing methods commonly apply high-resolution features or complex super-resolution strategies based on the two-stage Faster Region Convolutional Neural Network (RCNN). They sequentially apply localization and classification stages after a shared feature map extracted by one single backbone network. However, these methods cause low detection accuracy of small objects, high computational overhead, and waste of hardware resources. In this paper, we develop a high-accuracy and real-time small object detection system with negligible computational overhead and low hardware idleness. At the software level, we propose a two-stage Coarse-to-Fine Decoupling RCNN (CFD RCNN) with three techniques: (1) The shared backbone decoupling for localization and classification to achieve high accuracy for both tasks; (2) The training method using backbone feature upsampling for localization with low computational overhead; (3) The object cropping strategy from the original high-resolution image for high-accuracy classification. At the hardware level, we propose a virtualized FPGA accelerator with the Dynamic Resource Allocation (DRA) strategy. The DRA strategy reallocates the hardware resources, considering the workload and resource preference of each stage in CFD RCNN to reduce hardware idleness. Extensive experiments on the TT100K and GTSDB datasets using Xilinx ZCU102 FPGA show that the proposed small object detection system can achieve 2.9% improvement in mean average precision (mAP) compared with state-of-the-art (SOTA) algorithms and raised the throughput from 18.9 FPS to > 26.0 FPS (~1.37×) compared with existing accelerators.

An Efficient FPGA Implementation for Real-Time and Low-Power UAV Object Detection

Energy-Efficient Real-Time UAV Object Detection on Embedded Platforms

A UAV Detection Method Based on Signal Periodicity and Its Implementation on FPGA

Efficient depthwise separable convolution accelerator for classification and UAV object detection

Algorithm-Hardware Co-Optimization for Energy-Efficient Drone Detection on Resource-Constrained FPGA

A Comprehensive Analysis of DAC-SDC FPGA Low Power Object Detection Challenge

Super accurate low latency object detection on a surveillance UAV

A Real-Time FPGA Accelerator Based on Winograd Algorithm for Underwater Object Detection

SkyNet: A Champion Model for DAC-SDC on Low Power Object Detection

FPGA-based Real-time Video Quality Enhancement for Unmanned Aerial Vehicle

Towards High-accuracy and Real-time Two-stage Small Object Detection on FPGA

High Power-Efficient and Performance-Density FPGA Accelerator for CNN-Based Object Detection

Edge-Cloud Collaborative UAV Object Detection: Edge-Embedded Lightweight Algorithm Design and Task Offloading Using Fuzzy Neural Network

EUAVDet: an Efficient and Lightweight Object Detector for UAV Aerial Images with an Edge-Based Computing Platform

UAV Inspection Technology Based on Lightweight Edge Computing Framework

Efficient Object Detection Model for Real-Time UAV Applications

FasterX: Real-Time Object Detection Based on Edge GPUs for UAV Applications

Real-time Detection Principle and Experimental Study of Low and Slow Small Flying Objects

Efficient Deployment of Single Shot Multibox Detector Network on FPGAs

Improved YOLOv7 Algorithm for Small Object Detection in Unmanned Aerial Vehicle Image Scenarios

FPGA-based Object Detection Acceleration Architecture Design