Polarized Image Fusion Method with Joint Target Polarization Material Information

Ju Liu,Jin Duan,Hao Zhang,Shuilian Hao
DOI: https://doi.org/10.1109/EIECS59936.2023.10435586
2023-01-01
Abstract:Polarization image fusion is the process of fusing polarization image and spectral image into a more complete image, through the full expression of complementary information, to achieve better information characterization effect of a single image, and to improve the performance of advanced image applications such as semantic segmentation and target detection. However, traditional polarized image fusion methods do not consider the bias characteristics of the scene target, and the fusion methods are mostly designed manually, which lack the validity information retention of different semantic objects in the scene, and the fusion rules are less robust. Therefore, we propose a new polarization image fusion method that considers the polarization material characteristics of the target. In order to realize the effective characterization of polarization and spectral information of targets with different materials, we design a polarization weighting branch through the polarization specular reflection and diffuse reflection components, and guide the fusion process through the weighting effect of this branch. In addition, we design an end-to-end coding and decoding polarization image fusion network architecture, which extracts the effective polarization and visible light information through the encoder, and generates the fused image under different weights by combining the polarization-weighted branch through the decoder. Experimental results show that our fusion method can better preserve the polarization image edges, gradient information and texture details of the intensity image. Quantitative and qualitative analyses show that our fusion method has superior visual effects.
What problem does this paper attempt to address?