Fengqi Guo,Jingping Zhu,Liqing Huang,Feng Li,Ning Zhang,Jinxin Deng,Haoxiang Li,Xiangzhe Zhang,Yuanchen Zhao,Huilin Jiang,Xun Hou
Abstract:Spectral–polarization imaging technology plays a crucial role in remote sensing detection, enhancing target identification and tracking capabilities by capturing both spectral and polarization information reflected from object surfaces. However, the acquisition of multi-dimensional data often leads to extensive datasets that necessitate comprehensive analysis, thereby impeding the convenience and efficiency of remote sensing detection. To address this challenge, we propose a fusion algorithm based on spectral–polarization characteristics, incorporating principal component analysis (PCA) and energy weighting. This algorithm effectively consolidates multi-dimensional features within the scene into a single image, enhancing object details and enriching edge features. The robustness and universality of our proposed algorithm are demonstrated through experimentally obtained datasets and verified with publicly available datasets. Additionally, to meet the requirements of remote sensing tracking, we meticulously designed a pseudo-color mapping scheme consistent with human vision. This scheme maps polarization degree to color saturation, polarization angle to hue, and the fused image to intensity, resulting in a visual display aligned with human visual perception. We also discuss the application of this technique in processing data generated by the Channel-modulated static birefringent Fourier transform imaging spectropolarimeter (CSBFTIS). Experimental results demonstrate a significant enhancement in the information entropy and average gradient of the fused image compared to the optimal image before fusion, achieving maximum increases of 88% and 94%, respectively. This provides a solid foundation for target recognition and tracking in airborne remote sensing detection.
environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is how to effectively fuse spectral and polarization image information in order to improve the ability of target identification and tracking in remote sensing detection. Specifically, the author proposes a fusion algorithm based on spectral - polarization characteristics, and combines principal component analysis (PCA) and an energy - weighted method to integrate multi - dimensional features into a single image, thereby enhancing object details and enriching edge features.
### Detailed description of the main problems:
1. **Challenges in multi - dimensional data processing**:
- Spectral - polarization imaging technology plays an important role in remote sensing detection. By capturing the spectral and polarization information reflected from the object surface, it enhances the ability of target identification and tracking.
- However, obtaining multi - dimensional data usually results in a large number of data sets that need to be comprehensively analyzed, which affects the convenience and efficiency of remote sensing detection.
2. **Design of the fusion algorithm**:
- To meet this challenge, the author proposes a fusion algorithm based on spectral - polarization characteristics. This algorithm uses PCA for dimension reduction and fuses spectral images in different polarization directions through an energy - weighted method.
- This algorithm effectively integrates the multi - dimensional features in the scene into a single image, enhancing object details and enriching edge features.
3. **Pseudo - color mapping scheme**:
- To meet the needs of remote sensing tracking, the author designs a pseudo - color mapping scheme consistent with human visual perception. This scheme maps the degree of polarization to color saturation, the polarization angle to hue, and the fused image to brightness, thereby generating a visual display that conforms to human visual perception.
- In this way, not only the visual effect of the image is improved, but also the ability to capture scene details is enhanced.
4. **Application verification**:
- The author verifies the proposed algorithm through experimental data sets and public data sets and evaluates the fusion effect. The results show that the fused image not only effectively integrates polarization information, enhances target edge details, but also significantly improves the overall image quality.
- In addition, the author discusses the robustness of this technology in processing data generated by the channel - modulated static birefringence Fourier - transform imaging spectropolarimeter (CSBFTIS).
### Key formulas:
- **Stokes vector calculation**:
\[
S_\lambda(x, y) = \begin{bmatrix}
S_{0,\lambda}(x, y) \\
S_{1,\lambda}(x, y) \\
S_{2,\lambda}(x, y) \\
S_{3,\lambda}(x, y)
\end{bmatrix} = \begin{bmatrix}
I_{0,\lambda}(x, y) + I_{90,\lambda}(x, y) \\
I_{0,\lambda}(x, y) - I_{90,\lambda}(x, y) \\
I_{45,\lambda}(x, y) - I_{135,\lambda}(x, y) \\
I_{R,\lambda}(x, y) - I_{L,\lambda}(x, y)
\end{bmatrix}
\]
- **Calculation of the degree of linear polarization (DoLP)**:
\[
\text{DoLP}_\lambda(x, y) = \frac{\sqrt{S_{1,\lambda}^2(x, y) + S_{2,\lambda}^2(x, y)}}{S_{0,\lambda}(x, y)}
\]
- **Calculation of the polarization angle (AoP)**:
\[
\text{AoP}_\lambda(x, y) = \frac{1}{2} \tan^{-1}\left(\frac{S_{2,\lambda}(x, y)}{S_{1,\lambda}(x, y)}\right)
\]
In summary, this paper aims to solve the multi - dimensional data challenges in spectral - polarization image processing through innovative fusion algorithms and pseudo - color mapping schemes, and improve the target identification and tracking ability in remote sensing detection.