Unsupervised Anomaly Segmentation for Brain Lesions Using Dual Semantic-Manifold Reconstruction.

Zhiyuan Ding,Qi Dong,Haote Xu,Chenxin Li,Xinghao Ding,Yue Huang
DOI: https://doi.org/10.1007/978-3-031-30111-7_12
2022-01-01
Abstract:Unsupervised anomaly segmentation (UAS) is promising in many computer vision applications, e.g., the analysis of brain MRI, thanks to the advantage of detecting the anomalies (lesions) by only using the normal samples (healthy anatomies) in the training phase. Existing methods utilize the reconstruction process to model the normative distribution but inevitably lead to the impairment of localization information, which is critical for the pixel-level detection task. In this paper, we address this challenge by formulating a semantic layout of the healthy anatomy as the reconstruction manifold, which naturally forces the embedding to explicitly encode more semantic features as well as facilitates the preservation of spatial information during the reconstruction. Based on this special autoencoder framework of Semantic-Manifold Reconstruction (SMR), we further apply two consistency regularizations not only on the semantic layout but also the image appearance. In this way a Dual Semantic-Manifold Reconstruction (DSMR) is trained and then used to detect the anomalies accurately. Experiments reveal that the proposed DSMR approach exceeds the state-of-the-art performance on the benchmark datasets of BraTS and ISLES.
What problem does this paper attempt to address?