Abstract:Unmanned aerial vehicles (UAVs) have been widely applied in military and civilian fields, but they also pose great threats to restricted areas, such as densely populated areas and airports. Thermal infrared (IR) imaging technology is capable of monitoring UAVs at a long range in both day and night conditions. Therefore, the anti-UAV technology based on thermal IR imaging has attracted growing attention. However, the images acquired by IR sensors often suffer from small and dim targets, as well as heavy background clutter and noise. Conventional detection methods usually have a high false alarm rate and low detection accuracy. This article proposes a detection method that formulates the UAV detection as predicting the residual image (i.e., background, clutter, and noise) by learning the nonlinear mapping from the input image to the residual image. The UAV target image is obtained by subtracting the residual image from the input IR image. The constructed end-to-end U-shaped network exploits the depthwise separable residual dense blocks in the encoder stage to extract the abundant hierarchical features. Besides, the multiscale feature fusion and representation block is introduced to fully aggregate multiscale features from the encoder layers and intermediate connection layers at the same scale, as well as the decoder layers at different scales, to better reconstruct the residual image in the decoder stage. In addition, the global residual connection is adopted in the proposed network to provide long-distance information compensation and promote gradient backpropagation, which further improves the performance in reconstructing the image. The experimental results show that the proposed method achieves favorable detection performance in real-world IR images and outperforms other state-of-the-art methods in terms of quantitative and qualitative evaluation metrics.

Infrared Small UAV Target Detection Based on Depthwise Separable Residual Dense Network and Multiscale Feature Fusion

Fast Detection and Recognition Method of UAV in Sky Background

Low in Resolution, High in Precision: UAV Detection with Super-Resolution and Motion Information Extraction

A Small UAV Detection Method Based on Optical Flow and Visual Feature Fusion

Infrared Small UAV Target Detection Based on Residual Image Prediction via Global and Local Dilated Residual Networks

Infrared UAV Target Detection Based on Continuous-Coupled Neural Network

Detection of Military Targets on Ground and Sea by UAVs with Low-Altitude Oblique Perspective

Real-Time Recognition Algorithm of Small Target for UAV Infrared Detection

Small UAV Target Detection Model Based on Deep Neural Network

Feature-Enhanced Attention and Dual-GELAN Net (FEADG-Net) for UAV Infrared Small Object Detection in Traffic Surveillance

Differentiated Attention Guided Network over Hierarchical and Aggregated Features for Intelligent UAV Surveillance

Multi-band Image Fusion with Infrared Broad Spectrum for Low and Slow Small Target Recognition

Multiscale Progressive Fusion Filter Network for Infrared Small Target Detection

Research on Detection and Recognition Technology of a Visible and Infrared Dim and Small Target Based on Deep Learning

High-precision real-time UAV target recognition based on improved YOLOv4

Detection and tracking of infrared small target by jointly using SSD and pipeline filter

SCINet: Spatial and Contrast Interactive Super-Resolution Assisted Infrared UAV Target Detection

A Real-time Anti-distractor Infrared UAV Tracker with Channel Feature Refinement Module

Online Infrared UAV Target Tracking with Enhanced Context-Awareness and Pixel-Wise Attention Modulation

RTM-UAVDet: A Real-Time Multimodal UAV Detector

UAV infrared target tracking algorithm based on feature fusion and channel awareness