DTNet: A Specialized Dual-Tuning Network for Infrared Vehicle Detection in Aerial Images
Nan Zhang,Youmeng Liu,Hao Liu,Tian Tian,Jiayi Ma,Jinwen Tian
DOI: https://doi.org/10.1109/tgrs.2024.3386309
IF: 8.2
2024-04-19
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Vehicle detection in infrared aerial images is vital for both military and civilian applications, as infrared imaging remains effective under low-light conditions and various adverse weather scenarios. However, the longer wavelengths of long-wave infrared, compared to visible light, make diffraction more noticeable, leading to low-frequency degradation of vehicle information. Thermal radiation from the environment and optical system leads to higher noise in infrared images. Additionally, atmospheric transport models for various weather conditions can degrade infrared images to different extents. These factors lead to a reduced signal-to-noise ratio (SNR), which complicates the extraction of clear features. To overcome these challenges, we propose the dual-tuning network (DTNet), an advanced framework for vehicle detection in infrared aerial images, developed based on the mechanisms of infrared imaging. Specifically, the core component of DTNet is the dual-tuning block (DTBlock), which works alongside the dynamic guided filtering module (DGFM) and the point spread recovery module (PSRM) for feature extraction. DTBlock decomposes feature maps into low- and high-frequency components with learnable low-pass filters. DGFM eliminates disturbance from the optical system and background thermal radiation in the high-frequency component of feature maps, while preserving the details and texture of vehicles. PSRM aggregates vehicle features in the low-frequency component of feature maps, which is proposed with reference to diffraction and atmospheric models. The concept of dual-tuning refers to enhancing the signal and suppressing interference in the low- and high-frequency parts, respectively. Experimental results on the DroneVehicle public dataset for infrared vehicle detection indicate that our proposed approach achieves state-of-the-art (SOTA) performance. Moreover, extensive ablation studies confirm the superior capability of our DTNet in robust feature extraction from infrared images.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics