Abstract:Object detection algorithms are pivotal components of unmanned aerial vehicle (UAV) imaging systems, extensively employed in complex fields. However, images captured by high-mobility UAVs often suffer from motion blur cases, which significantly impedes the performance of advanced object detection algorithms. To address these challenges, we propose an innovative object detection algorithm specifically designed for blurry images, named DREB-Net (Dual-stream Restoration Embedding Blur-feature Fusion Network). First, DREB-Net addresses the particularities of blurry image object detection problem by incorporating a Blurry image Restoration Auxiliary Branch (BRAB) during the training phase. Second, it fuses the extracted shallow features via Multi-level Attention-Guided Feature Fusion (MAGFF) module, to extract richer features. Here, the MAGFF module comprises local attention modules and global attention modules, which assign different weights to the branches. Then, during the inference phase, the deep feature extraction of the BRAB can be removed to reduce computational complexity and improve detection speed. In loss function, a combined loss of MSE and SSIM is added to the BRAB to restore blurry images. Finally, DREB-Net introduces Fast Fourier Transform in the early stages of feature extraction, via a Learnable Frequency domain Amplitude Modulation Module (LFAMM), to adjust feature amplitude and enhance feature processing capability. Experimental results indicate that DREB-Net can still effectively perform object detection tasks under motion blur in captured images, showcasing excellent performance and broad application prospects. Our source code will be available at <a class="link-external link-https" href="https://github.com/EEIC-Lab/DREB-Net.git" rel="external noopener nofollow">this https URL</a>.

Image Restoration Via UAVFormer for Under-Display Camera of UAV.

Modular Degradation Simulation and Restoration for Under-Display Camera

Zero-Reference Image Restoration for Under-Display Camera of UAV

Low in Resolution, High in Precision: UAV Detection with Super-Resolution and Motion Information Extraction

Ground-to-air Aircraft Infrared Image Deblurring Based on Imaging Degradation Simulation

A Small UAV Detection Method Based on Optical Flow and Visual Feature Fusion

Image restoration for real-world under-display imaging

Deep Video Restoration for Under-Display Camera

Image Enhancement of Low Light UAV Via Global Illumination Self-aware Feature Estimation

Unformer: A Transformer-Based Approach for Adaptive Multi-Scale Feature Aggregation in Underwater Image Enhancement

DREB-Net: Dual-stream Restoration Embedding Blur-feature Fusion Network for High-mobility UAV Object Detection

Multi-patch de-raindrop Transformer for UAV images

Generating Aligned Pseudo-Supervision from Non-Aligned Data for Image Restoration in Under-Display Camera

Segmentation Guided Sparse Transformer for Under-Display Camera Image Restoration

Zero-referenced Enlightening and Restoration for UAV Nighttime Vision

Enhanced Coarse-to-Fine Network for Image Restoration from Under-Display Cameras.

ULSR-UV: an ultra-lightweight super-resolution networks for UAV video

A Real-Time Incremental Video Mosaic Framework for UAV Remote Sensing.

Under-Display Camera Image Restoration with Scattering Effect

Cascaded Denoising Transformer for UAV Nighttime Tracking

Dual-Domain Network for Restoring Images from Under-Display Cameras.