A weighted feature transfer gan for medical image synthesis

Shuaizhen Yao,Jianhua Tan,Yi Chen,Yanhui Gu
DOI: https://doi.org/10.1007/s00138-020-01152-8
IF: 2.983
2020-11-21
Machine Vision and Applications
Abstract:Recent studies have shown that CycleGAN is a highly influential medical image synthesis model. However, the lack of sufficient constraints and the bottleneck layer in auto-encoder network usually lead to blurry image and meaningless features, which may affect medical judgment. In order to synthesize accurate and meaningful medical images, weighted feature transfer GAN (WFT-GAN) is proposed to improve the quality of generated medical image, which is applied to the synthesis of unpaired multi-modal data. WFT-GAN adopts weighted feature transfer (WFT) instead of traditional skip connection to reduce the interference of encoding information on image decoding, while retaining the advantage of skip connection to the information transmission of the generated image. Moreover, the local perceptual adversarial loss combines the VGG feature map and adversarial model to make the local features of the image more meaningful. Experiments in three data sets show that the method in this paper can synthesize higher-quality medical images.
computer science, cybernetics, artificial intelligence,engineering, electrical & electronic
What problem does this paper attempt to address?