Abstract:The fusion of spectral–polarimetric information can improve the autonomous reconnaissance capability of unmanned aerial vehicles (UAVs) in detecting artificial targets. However, the current spectral and polarization imaging systems typically suffer from low image sampling resolution, which can lead to the loss of target information. Most existing segmentation algorithms neglect the similarities and differences between multimodal features, resulting in reduced accuracy and robustness of the algorithms. To address these challenges, a real-time spectral–polarimetric segmentation algorithm for artificial targets based on an efficient attention fusion network, called ESPFNet (efficient spectral–polarimetric fusion network) is proposed. The network employs a coordination attention bimodal fusion (CABF) module and a complex atrous spatial pyramid pooling (CASPP) module to fuse and enhance low-level and high-level features at different scales from the spectral feature images and the polarization encoded images, effectively achieving the segmentation of artificial targets. Additionally, the introduction of the residual dense block (RDB) module refines feature extraction, further enhancing the network's ability to classify pixels. In order to test the algorithm's performance, a spectral–polarimetric image dataset of artificial targets, named SPIAO (spectral–polarimetric image of artificial objects) is constructed, which contains various camouflaged nets and camouflaged plates with different properties. The experimental results on the SPIAO dataset demonstrate that the proposed method accurately detects the artificial targets, achieving a mean intersection-over-union (MIoU) of 80.4%, a mean pixel accuracy (MPA) of 88.1%, and a detection rate of 27.5 frames per second, meeting the real-time requirement. The research has the potential to provide a new multimodal detection technique for enabling autonomous reconnaissance by UAVs in complex scenes.

Color-polarization synergistic target detection method considering shadow interference

The Method Of Infrared Polariametric Imaging

Polarimetric Target Depth Sensing in Ambient Illumination Based on Polarization-Coded Structured Light.

Research on polarization imaging detection and tracking method of low-speed and small UAV targets

Dynamic Shadow Detection Based on Micro Unmanned Helicopter Platform

Real-Time Segmentation of Artificial Targets Using a Dual-Modal Efficient Attention Fusion Network

Polarization-Based Reflection Suppression Method and Its Application to Target Detection

Real-Time Polarization Spectral Detection Based on a Dual-Dispersion and Coded-Aperture Imaging System.

A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation

A Dual-Mode Intensity and Polarized Imaging System for Assisting Autonomous Driving

Object Detection by Spectropolarimeteric Imagery Fusion

Shadow Detection in Remote Sensing Images Based on Spectral Radiance Separability Enhancement

Multi-Dimensional Fusion of Spectral and Polarimetric Images Followed by Pseudo-Color Algorithm Integration and Mapping in HSI Space

Polarization motivating high-performance weak targets’ imaging based on a dual-discriminator GAN

Polarization-intensity joint imaging for marine target automatic recognition

Polarization-driven camouflaged object segmentation via gated fusion

UAV Target Detection under Complex Sky Background

Analysis of multispectral polarization imaging image information based on micro-polarizer array

Shadow-aided method for ground slow moving targets detection of airborne high-resolution SAR images

Dynamic Dark Channel Prior Dehazing with Polarization

Contrast Enhanced Color Polarization Image Fusion