Abstract:Visual object tracking has boosted extensive intelligent applications for unmanned aerial vehicles (UAVs). However, the state-of-the-art (SOTA) enhancers for nighttime UAV tracking always neglect the uneven light distribution in low-light images, inevitably leading to excessive enhancement in scenarios with complex illumination. To address these issues, this work proposes a novel enhancer, i.e., LDEnhancer, enhancing nighttime UAV tracking with light distribution suppression. Specifically, a novel image content refinement module is developed to decompose the light distribution information and image content information in the feature space, allowing for the targeted enhancement of the image content information. Then this work designs a new light distribution generation module to capture light distribution effectively. The features with light distribution information and image content information are fed into the different parameter estimation modules, respectively, for the parameter map prediction. Finally, leveraging two parameter maps, an innovative interweave iteration adjustment is proposed for the collaborative pixel-wise adjustment of low-light images. Additionally, a challenging nighttime UAV tracking dataset with uneven light distribution, namely NAT2024-2, is constructed to provide a comprehensive evaluation, which contains 40 challenging sequences with over 74K frames in total. Experimental results on the authoritative UAV benchmarks and the proposed NAT2024-2 demonstrate that LDEnhancer outperforms other SOTA low-light enhancers for nighttime UAV tracking. Furthermore, real-world tests on a typical UAV platform with an NVIDIA Orin NX confirm the practicality and efficiency of LDEnhancer. The code is available at <a class="link-external link-https" href="https://github.com/vision4robotics/LDEnhancer" rel="external noopener nofollow">this https URL</a>.

DaDiff: Domain-aware Diffusion Model for Nighttime UAV Tracking

Prompt-Driven Temporal Domain Adaptation for Nighttime UAV Tracking

Unsupervised Domain Adaptation for Nighttime Aerial Tracking

SAM-DA: UAV Tracks Anything at Night with SAM-Powered Domain Adaptation

Enhancing Nighttime UAV Tracking with Light Distribution Suppression

Mutual-Learning Knowledge Distillation for Nighttime UAV Tracking

Unsupervised Nighttime Object Tracking Based on Transformer and Domain Adaptation Fusion Network

ADTrack: Target-Aware Dual Filter Learning for Real-Time Anti-Dark UAV Tracking

All-Day Object Tracking for Unmanned Aerial Vehicle

Tracker Meets Night: A Transformer Enhancer for UAV Tracking

DCPT: Darkness Clue-Prompted Tracking in Nighttime UAVs

MambaNUT: Nighttime UAV Tracking via Mamba and Adaptive Curriculum Learning

AutoTrack: Towards High-Performance Visual Tracking for UAV With Automatic Spatio-Temporal Regularization

Scale-Aware Domain Adaptation for Robust UAV Tracking

Conditional Generative Denoiser for Nighttime UAV Tracking

Towards Discriminative Representations with Contrastive Instances for Real-Time UAV Tracking

Enhancing UAV tracking: a focus on discriminative representations using contrastive instances

SGDViT: Saliency-Guided Dynamic Vision Transformer for UAV Tracking

Learning Aberrance Repressed Correlation Filters for Real-Time UAV Tracking

Learning Motion Blur Robust Vision Transformers with Dynamic Early Exit for Real-Time UAV Tracking

Light the Night: A Multi-Condition Diffusion Framework for Unpaired Low-Light Enhancement in Autonomous Driving