Multi-scale Generative Adversarial Network for Automatic Sublingual Vein Segmentation

Qingyue Xiong,Xinlei Li,Dawei Yang,Wei Zhang,Ye Zhang,Yajie Kong,Fufeng Li,Wenqiang Zhang
DOI: https://doi.org/10.1109/BIBM49941.2020.9313105
2020-01-01
Abstract:Sublingual vein segmentation is an essential yet challenging task in computer-aided Traditional Chinese Medicine (TCM) tongue diagnosis. The most intricate part of sublingual vein segmentation is the strong diversity of sublingual vein images (e.g., various exposure of vein and complex background) and the natural connectivity of veins. To this end, we propose a novel and effective approach based on generative adversarial networks (GANs). Specifically, the framework comprises two modules: a segmentation generator network with multi-scale outputs and a scale-consistent discriminator. The former segmentation generator learns the overall structure of the segmentation, which reduces the training difficulties of stride 1 output by multi-scale outputs. The latter scale-consistent discriminator regularizes the segmentation maps from different output strides, which keeps the natural connectivity of veins and avoids generated noise. Additionally, we have constructed and publicized a well-annotated sublingual vein dataset (FDU-SV) which we believe will promote the significant development of this area. Extensive experimental results confirm that our method outperforms other representative segmentation models with a remarkable margin, achieving the state-of-the-art performance of 64.53% mIoU score.
What problem does this paper attempt to address?