Abstract:Object detection via deep neural networks has undergone considerable advancements in recent years. Yet, the detection of smaller objects, specifically those with a few pixels (i.e., < 322 pixels), is still challenging compared with large objects (i.e., > 962 pixels). Existing methods commonly apply high-resolution features or complex super-resolution strategies based on the two-stage Faster Region Convolutional Neural Network (RCNN). They sequentially apply localization and classification stages after a shared feature map extracted by one single backbone network. However, these methods cause low detection accuracy of small objects, high computational overhead, and waste of hardware resources. In this paper, we develop a high-accuracy and real-time small object detection system with negligible computational overhead and low hardware idleness. At the software level, we propose a two-stage Coarse-to-Fine Decoupling RCNN (CFD RCNN) with three techniques: (1) The shared backbone decoupling for localization and classification to achieve high accuracy for both tasks; (2) The training method using backbone feature upsampling for localization with low computational overhead; (3) The object cropping strategy from the original high-resolution image for high-accuracy classification. At the hardware level, we propose a virtualized FPGA accelerator with the Dynamic Resource Allocation (DRA) strategy. The DRA strategy reallocates the hardware resources, considering the workload and resource preference of each stage in CFD RCNN to reduce hardware idleness. Extensive experiments on the TT100K and GTSDB datasets using Xilinx ZCU102 FPGA show that the proposed small object detection system can achieve 2.9% improvement in mean average precision (mAP) compared with state-of-the-art (SOTA) algorithms and raised the throughput from 18.9 FPS to > 26.0 FPS (~1.37×) compared with existing accelerators.

Efficient FPGA Implementation of Human Detection from Video Sequences

Adaptive Human Detection Approach Using FPGA-based Parallel Architecture in Reconfigurable Hardware.

Video Based Head Detection and Tracking Surveillance System

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

Parallel Hough Transform-based straight line detection and its FPGA implementation in embedded vision

A High-Performance HOG Extractor on FPGA

Hardware Architecture for Fast General Object Detection using Aggregated Channel Features

A Real-Time Human Detection System for Video.

Real-Time Face Detection and Human Tracking System on FPGA Cyclone-V

Efficient Hardware Post Processing of Anchor-Based Object Detection on FPGA

Human tracking of track and field athletes based on FPGA and computer vision

Upper Body Human Detection and Segmentation in Low Contrast Video

Low-Power Lane Detection Unit With Sliding-Based Parallel Segment Detection Accelerator for FPGA

FPGA Implementation of a Hardware Optimized Automatic Target Detection and Classification Algorithm for Hyperspectral Image Analysis

On-Board Detection and Matching of Feature Points

FPGA-Based Pedestrian Detection for Collision Prediction System

Hardware Acceleration of Lane Detection Algorithm: A GPU Versus FPGA Comparison

Towards High-accuracy and Real-time Two-stage Small Object Detection on FPGA

Real-Time Straight-Line Detection for XGA-Size Videos by Hough Transform with Parallelized Voting Procedures

Efficient Edge Detection on Low-Cost FPGAs