Thermal Infrared Colorization Via Conditional Generative Adversarial Network

Xiaodong Kuang,Jianfei Zhu,Xiubao Sui,Yuan Liu,Chengwei Liu,Qian Chen,Guohua Gu
DOI: https://doi.org/10.1016/j.infrared.2020.103338
IF: 2.997
2020-01-01
Infrared Physics & Technology
Abstract:Transforming a thermal infrared image into a realistic RGB image is a challenging task. In this paper we propose a deep learning method to bridge this gap. We propose learning the transformation mapping using a coarse-to-fine generator that preserves the details. Since the standard mean squared loss cannot penalize the distance between colorized and ground truth images well, we propose a composite loss function that combines content, adversarial, perceptual and total variation losses. The content loss is used to recover global image information while the latter three losses are used to synthesize local realistic textures. Quantitative and qualitative experiments demonstrate that our approach significantly outperforms existing approaches on the KAIST multispectral pedestrian dataset, achieving more plausible RGB images. Our code is available online(2).( )
What problem does this paper attempt to address?