Colorization for Medical Images Based on Patient-Specific Prior Information and GAN Features

Yonglong Zhang,Yizhou Chen,Wenbo Pang,Huiyan Jiang
DOI: https://doi.org/10.1007/978-981-16-3013-2_19
2021-01-01
Abstract:Medical images are mostly gray-scale images. Colorization for medical images can make them have better visualization effect and provide more diagnostic information for doctors. This paper proposes a colorization method for medical images based on prior explicit features and Generative Adversarial Networks implicit features. Firstly, patient attribute features are extracted based on the clinical prior knowledge, including age, gender, drug intake, etc. Meanwhile, image domain features are extracted from gray image, like texture, intensity value and others. Then, the feature value of each point is calculated to obtain the prior feature map. Secondly, the prior feature map and the original image are input to Generative Adversarial Networks to complete end-to-end training of the network. In addition, the method introduces a new loss function with prior explicit features and GAN features to constrain the network learning direction. This method has achieved good performance on both e-anatomy data set and our local dataset. The mean square error is reduced by 30.889 and the peak signal-to-noise ratio is increased by 5.116. Experimental results show that our method is superior in colorization for medical images.
What problem does this paper attempt to address?