Abstract:The fusion of spectral–polarimetric information can improve the autonomous reconnaissance capability of unmanned aerial vehicles (UAVs) in detecting artificial targets. However, the current spectral and polarization imaging systems typically suffer from low image sampling resolution, which can lead to the loss of target information. Most existing segmentation algorithms neglect the similarities and differences between multimodal features, resulting in reduced accuracy and robustness of the algorithms. To address these challenges, a real-time spectral–polarimetric segmentation algorithm for artificial targets based on an efficient attention fusion network, called ESPFNet (efficient spectral–polarimetric fusion network) is proposed. The network employs a coordination attention bimodal fusion (CABF) module and a complex atrous spatial pyramid pooling (CASPP) module to fuse and enhance low-level and high-level features at different scales from the spectral feature images and the polarization encoded images, effectively achieving the segmentation of artificial targets. Additionally, the introduction of the residual dense block (RDB) module refines feature extraction, further enhancing the network's ability to classify pixels. In order to test the algorithm's performance, a spectral–polarimetric image dataset of artificial targets, named SPIAO (spectral–polarimetric image of artificial objects) is constructed, which contains various camouflaged nets and camouflaged plates with different properties. The experimental results on the SPIAO dataset demonstrate that the proposed method accurately detects the artificial targets, achieving a mean intersection-over-union (MIoU) of 80.4%, a mean pixel accuracy (MPA) of 88.1%, and a detection rate of 27.5 frames per second, meeting the real-time requirement. The research has the potential to provide a new multimodal detection technique for enabling autonomous reconnaissance by UAVs in complex scenes.

A Real-Time Hough-Based Method for Segment Detection in Complex Multisensor Images

Multiscale Feature-Based Infrared Ship Detection

Multi-objects Real Time Recognition Based on Color Information

Linear Feature Detection for Hyperspectral Subpixel Mapping

Fast Algorithm Based on Triplet Markov Fields for Unsupervised Multi-Class Segmentation of SAR Images

Step-by-step Pipeline Processing Approach for Line Segment Detection.

A Dual-Branch Deep Learning Architecture for Multisensor and Multitemporal Remote Sensing Semantic Segmentation

Hybrid image segmentation using watersheds and fast region merging

A Hybrid Thresholding Method for Water Extraction in Envisat Image

Edge-Guided Image Object Detection in Multiscale Segmentation for High-Resolution Remotely Sensed Imagery.

A new segmentation method for very high resolution imagery using spectral and morphological information

Hy-Seg: A Hybrid Method for Ground Segmentation Using Point Clouds

Segmentation for Multi-target from Multi-sensor Images Based on Image Morphology and Histogram Analysis Method

Edge-Guided Multiscale Segmentation of Satellite Multispectral Imagery

Segmentation of sonar imagery using convolutional neural networks and Markov random field

Real-Time Segmentation of Artificial Targets Using a Dual-Modal Efficient Attention Fusion Network

Real-time People Tracking and Identification from Sparse mm-Wave Radar Point-clouds

Fast Multiscale Superpixel Segmentation for SAR Imagery

A New Spatio-Spectral Morphological Segmentation For Multi-Spectral Remote-Sensing Images

Visual Attention-Based Target Detection and Discrimination for High-Resolution SAR Images in Complex Scenes

Multi-target Segmentation in Multi-sensor Images in Complex Scenes