Polarization Maintaining 3-D Convolutional Neural Network for Color Polarimetric Images Denoising
Hedong Liu,Xiaobo Li,Zhenzhou Cheng,Tiegen Liu,Jingsheng Zhai,Haofeng Hu
DOI: https://doi.org/10.1109/tim.2023.3261929
IF: 5.6
2023-04-08
IEEE Transactions on Instrumentation and Measurement
Abstract:Color polarimetric imaging could provide multidimensional information that provides physical properties related to object shape, surface roughness, etc. Therefore, it has been widely used in various instrumentation and measurement applications, such as 3-D measurement, surface detection, and navigation. However, compared to conventional color images, polarimetric images have a lower signal-to-noise ratio (SNR) and are more sensitive to noise, which leads to unpleasant noisy images and destroys polarization analysis performance. Moreover, the multiple dimensions and physical relationships among dimensions make the issue of denoise more complicated and challenging. When denoising color polarimetric images, the coherence among the space, color, and polarization is significant but has not been fully exploited by existing methods. In this article, we propose a 3-D convolutional neural network (CNN) for denoising color polarimetric images. 3-D convolutions are applied to extract information from multiple dimensions, i.e., the space, color, and polarization. In particular, we also found that 3-D features derived from color polarimetric images still satisfy the Stokes relationship after 3-D convolution. In other words, polarization properties are maintained. Experiments show that the proposed denoising method can well remove noises and restore polarization information in all channels. The proposed denoising method may find important applications for other multidimensional imaging tasks.
engineering, electrical & electronic,instruments & instrumentation