Hippocampus Substructure Segmentation Using Morphological Vision Transformer Learning

Yang Lei,Yifu Ding,Richard L.J. Qiu,Tonghe Wang,Justin Roper,Yabo Fu,Hui-Kuo Shu,Hui Mao,Xiaofeng Yang
2023-06-15
Abstract:Background: The hippocampus plays a crucial role in memory and cognition. Because of the associated toxicity from whole brain radiotherapy, more advanced treatment planning techniques prioritize hippocampal avoidance, which depends on an accurate segmentation of the small and complexly shaped hippocampus. Purpose: To achieve accurate segmentation of the anterior and posterior regions of the hippocampus from T1 weighted (T1w) MRI images, we developed a novel model, Hippo-Net, which uses a mutually enhanced strategy. Methods: The proposed model consists of two major parts: 1) a localization model is used to detect the volume-of-interest (VOI) of hippocampus. 2) An end-to-end morphological vision transformer network is used to perform substructures segmentation within the hippocampus VOI. A total of 260 T1w MRI datasets were used in this study. We conducted a five-fold cross-validation on the first 200 T1w MR images and then performed a hold-out test on the remaining 60 T1w MR images with the model trained on the first 200 images. Results: In five-fold cross-validation, the DSCs were 0.900+-0.029 and 0.886+-0.031for the hippocampus proper and parts of the subiculum, respectively. The MSD were 0.426+-0.115mm and 0.401+-0.100 mm for the hippocampus proper and parts of the subiculum, respectively. Conclusions: The proposed method showed great promise in automatically delineating hippocampus substructures on T1w MRI images. It may facilitate the current clinical workflow and reduce the physician effort.
Medical Physics
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve The paper aims to address the precise segmentation of the hippocampus and its substructures. Specifically, the goal is to develop a new deep learning model capable of accurately segmenting the anterior and posterior regions of the hippocampus in T1-weighted (T1w) MRI images, defined as the hippocampus proper and part of the subiculum, respectively. ### Background and Motivation 1. **Importance of the Hippocampus**: - The hippocampus plays a crucial role in memory and cognitive functions. - In whole-brain radiotherapy, advanced treatment planning techniques prioritize avoiding the hippocampus due to the toxicity associated with whole-brain radiotherapy, which relies on precise segmentation of the small and complex hippocampus. 2. **Limitations of Existing Methods**: - Manual segmentation of the hippocampus is a tedious and error-prone process, limiting its application in big data and clinical practice. - Existing automatic segmentation methods (such as atlas-based methods and traditional machine learning methods) struggle with the low contrast, irregular shape, and small volume of the hippocampus. ### Method Overview 1. **Localization Model**: - Used to detect the volume of interest (VOI) of the hippocampus to reduce the computational burden of subsequent segmentation tasks. - Achieved through multi-scale feature extraction and a position estimation neural network. 2. **Morphological Vision Transformer Network**: - Used for substructure segmentation within the hippocampus VOI. - Combines key features extracted from MRI images and enhances segmentation capability through learned morphological operators. ### Experimental Results - **Cross-Validation**: - In 5-fold cross-validation, the Dice similarity coefficient (DSC) for the hippocampus proper and part of the subiculum were 0.900±0.029 and 0.886±0.031, respectively. - The mean surface distance (MSD) was 0.426±0.115mm and 0.401±0.100mm, respectively. - **Independent Testing**: - In independent testing, the DSC for the hippocampus proper and part of the subiculum were 0.881±0.033 and 0.863±0.034, respectively. - The MSD was 0.494±0.113mm and 0.466±0.112mm, respectively. ### Conclusion - The proposed method performs excellently in the automatic segmentation of hippocampal substructures, with high accuracy and robustness. - This method is expected to simplify current clinical workflows and reduce the workload of physicians. ### Clinical Significance - In hippocampal-avoidance whole-brain radiotherapy (HA-WBRT), more precise substructure segmentation can achieve better protection of critical parts of the hippocampus, thereby improving patient outcomes.