Abstract:Spectral–polarization imaging technology plays a crucial role in remote sensing detection, enhancing target identification and tracking capabilities by capturing both spectral and polarization information reflected from object surfaces. However, the acquisition of multi-dimensional data often leads to extensive datasets that necessitate comprehensive analysis, thereby impeding the convenience and efficiency of remote sensing detection. To address this challenge, we propose a fusion algorithm based on spectral–polarization characteristics, incorporating principal component analysis (PCA) and energy weighting. This algorithm effectively consolidates multi-dimensional features within the scene into a single image, enhancing object details and enriching edge features. The robustness and universality of our proposed algorithm are demonstrated through experimentally obtained datasets and verified with publicly available datasets. Additionally, to meet the requirements of remote sensing tracking, we meticulously designed a pseudo-color mapping scheme consistent with human vision. This scheme maps polarization degree to color saturation, polarization angle to hue, and the fused image to intensity, resulting in a visual display aligned with human visual perception. We also discuss the application of this technique in processing data generated by the Channel-modulated static birefringent Fourier transform imaging spectropolarimeter (CSBFTIS). Experimental results demonstrate a significant enhancement in the information entropy and average gradient of the fused image compared to the optimal image before fusion, achieving maximum increases of 88% and 94%, respectively. This provides a solid foundation for target recognition and tracking in airborne remote sensing detection.

Hypercomplex Principle Component Weighted Approach to Multiplespectral and Panchromatic Images Fusions

Curvelet Based Hyperspectral Image Fusion

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Multi-focus Color Image Fusion in the HSI Space Using the Sum-Modified-laplacian and a Coarse Edge Map

Region-aware RGB and Near-Infrared Image Fusion

Residual Error Hypercomplex Symplectic Decomposition Approach to Multispectral and Panchromatic Image Fusions

The Realistic Fusion of Multi-spectral Images

Principle Component Analysis Based Hyperspectral Image Fusion in Imaging Spectropolarimeter

A new method for multi-source remote sensing image fusion

Comprehensive Evaluation for Fused Images of Multispectral and Panchromatic Images Based on Entropy Weight Method

Multi-Spectral and Panchromatic Image Fusion Based on His-Wavelet Transform and Mopso Algorithm

Optimal Fusion of Multi-spectral Images under Correlation Coefficient Criteria

A new scheme for fusion of multispectral and panchromatic images based on residual error

Detail enhanced multi-source fusion using visual weight map extraction based on multi scale edge preserving decomposition

Fusion Algorithms for Multispectral and Panchromatic Image Based on Wavelet Transformation

Weighted IHS Fusion of Multi-source Remotely-Sensed Image Based on Edge Detection Using Grey Absolute Correlation Degree

Pca and Wavelet Transform for Fusing Panchromatic and Multi-Spectral Images

A pixel-level fusion method for multi-source optical remote sensing image combining the principal component analysis and curvelet transform

Multi-Dimensional Fusion of Spectral and Polarimetric Images Followed by Pseudo-Color Algorithm Integration and Mapping in HSI Space

Infrared and visible image fusion method based on principal component analysis network and multi-scale morphological gradient