Hartmut Häntze,Lina Xu,Christian J. Mertens,Felix J. Dorfner,Leonhard Donle,Felix Busch,Avan Kader,Sebastian Ziegelmayer,Nadine Bayerl,Nassir Navab,Daniel Rueckert,Julia Schnabel,Hugo JWL Aerts,Daniel Truhn,Fabian Bamberg,Jakob Weiß,Christopher L. Schlett,Steffen Ringhof,Thoralf Niendorf,Tobias Pischon,Hans-Ulrich Kauczor,Tobias Nonnenmacher,Thomas Kröncke,Henry Völzke,Jeanette Schulz-Menger,Klaus Maier-Hein,Mathias Prokop,Bram van Ginneken,Alessa Hering,Marcus R. Makowski,Lisa C. Adams,Keno K. Bressem

Abstract:Purpose: To develop and evaluate a deep learning model for multi-organ segmentation of MRI scans. Materials and Methods: The model was trained on 1,200 manually annotated 3D axial MRI scans from the UK Biobank, 221 in-house MRI scans, and 1228 CT scans from the TotalSegmentator dataset. A human-in-the-loop annotation workflow was employed, leveraging cross-modality transfer learning from an existing CT segmentation model to segment 40 anatomical structures. The annotation process began with a model based on transfer learning between CT and MR, which was iteratively refined based on manual corrections to predicted segmentations. The model's performance was evaluated on MRI examinations obtained from the German National Cohort (NAKO) study (n=900) from the AMOS22 dataset (n=60) and from the TotalSegmentator-MRI test data (n=29). The Dice Similarity Coefficient (DSC) and Hausdorff Distance (HD) were used to assess segmentation quality, stratified by organ and scan type. The model and its weights will be open-sourced. Results: MRSegmentator demonstrated high accuracy for well-defined organs (lungs: DSC 0.96, heart: DSC 0.94) and organs with anatomic variability (liver: DSC 0.96, kidneys: DSC 0.95). Smaller structures showed lower accuracy (portal/splenic veins: DSC 0.64, adrenal glands: DSC 0.69). On external validation using NAKO data, mean DSC ranged from 0.85 $\pm$ 0.08 for T2-HASTE to 0.91 $\pm$ 0.05 for in-phase sequences. The model generalized well to CT, achieving mean DSC of 0.84 $\pm$ 0.11 on AMOS CT data. Conclusion: MRSegmentator accurately segments 40 anatomical structures in MRI across diverse datasets and imaging protocols, with additional generalizability to CT images. This open-source model will provide a valuable tool for automated multi-organ segmentation in medical imaging research. It can be downloaded from <a class="link-external link-https" href="https://github.com/hhaentze/MRSegmentator" rel="external noopener nofollow">this https URL</a>.

MRAnnotator: A Multi-Anatomy Deep Learning Model for MRI Segmentation

MRSegmentator: Multi-Modality Segmentation of 40 Classes in MRI and CT

DeepMRSeg: A convolutional deep neural network for anatomy and abnormality segmentation on MR images

SegmentAnyBone: A Universal Model that Segments Any Bone at Any Location on MRI

Collaborative Learning for Annotation-Efficient Volumetric MR Image Segmentation

TotalSegmentator MRI: Sequence-Independent Segmentation of 59 Anatomical Structures in MR images

MMAN: Multi-modality aggregation network for brain segmentation from MR images.

Carotid Vessel Wall Segmentation Through Domain Aligner, Topological Learning, and Segment Anything Model for Sparse Annotation in MR Images

Abdominal multi-organ segmentation in Multi-sequence MRIs based on visual attention guided network and knowledge distillation

MRISegmentator-Abdomen: A Fully Automated Multi-Organ and Structure Segmentation Tool for T1-weighted Abdominal MRI

Semi-Supervised 3D Abdominal Multi-Organ Segmentation Via Deep Multi-Planar Co-Training

Semi-Supervised Multi-Organ Segmentation Via Deep Multi-Planar Co-Training

Pseudo-3D Network for Multi-sequence Cardiac MR Segmentation

Fully Automatic Segmentation of Short-Axis Cardiac MRI Using Modified Deep Layer Aggregation.

Multi-Source Data Integration for Segmentation of Unannotated MRI Images

Semi-Supervised Deep Learning for Multi-Tissue Segmentation from Multi-Contrast MRI

A medical image segmentation method for rectal tumors based on multi‐scale feature retention and multiple attention mechanisms

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

MT-NeT: Multi-Modality Transfer Learning Network for Automated Carotid Vessel Wall Segmentation Using Sparse Annotation in MRI.

Fully Automated Multi-Organ Segmentation in Abdominal Magnetic Resonance Imaging with Deep Neural Networks

Deep learning-based image segmentation model using an MRI-based convolutional neural network for physiological evaluation of the heart