Abstract:PURPOSE:In the past decade, there has been a rapid increase in the development of automatic cardiac segmentation methods. However, the automatic quality control (QC) of these segmentation methods has received less attention. This study aims to address this gap by developing an automatic pipeline that incorporates DL-based cardiac segmentation and radiomics-based quality control. METHODS:In the DL-based localization and segmentation part, the entire heart was first located and cropped. Then, the cropped images were further utilized for the segmentation of the right ventricle cavity (RVC), myocardium (MYO), and left ventricle cavity (LVC). As for the radiomics-based QC part, a training radiomics dataset was created with segmentation tasks of various quality. This dataset was used for feature extraction, selection, and QC model development. The model performance was then evaluated using both internal and external testing datasets. RESULTS:In the internal testing dataset, the segmentation model demonstrated a great performance with a dice similarity coefficient (DSC) of 0.954 for whole heart segmentations. Images were then appropriately cropped to 160 × 160 pixels. The models also performed well for cardiac substructure segmentations. The DSC values were 0.863, 0.872, and 0.940 for RVC, MYO, and LVC for 2D masks and 0.928, 0.886, and 0.962 for RVC, MYO, and LVC for 3D masks with an attention-UNet. After feature selection with the radiomics dataset, we developed a series of models to predict the automatic segmentation quality and its DSC value for the RVC, MYO, and LVC structures. The mean absolute values for our best prediction models were 0.060, 0.032, and 0.021 for 2D segmentations and 0.027, 0.017, and 0.011 for 3D segmentations, respectively. Additionally, the radiomics-based classification models demonstrated a high negative detection rate of >0.85 in all 2D groups. In the external dataset, models showed similar results. CONCLUSIONS:We developed a pipeline including cardiac substructure segmentation and QC at both the slice (2D) and subject (3D) levels. Our results demonstrate that the radiomics method possesses great potential for the automatic QC of cardiac segmentation.

SegQC: a segmentation network-based framework for multi-metric segmentation quality control and segmentation error detection in volumetric medical images

Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach

Efficient Segmentation Method Using Quantised and Non‐linear CeNN for Breast Tumour Classification

Automated Quality Control in Image Segmentation: Application to the UK Biobank Cardiac MR Imaging Study

Quality Control-Driven Image Segmentation Towards Reliable Automatic Image Analysis in Large-Scale Cardiovascular Magnetic Resonance Aortic Cine Imaging

Automated quality control in image segmentation: application to the UK Biobank cardiovascular magnetic resonance imaging study

QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Prediction

FetMRQC: Automated Quality Control for fetal brain MRI

Segmentation quality assessment by automated detection of erroneous surface regions in medical images

FUSQA: Fetal Ultrasound Segmentation Quality Assessment

Radiomics-Based Quality Control System for Automatic Cardiac Segmentation: A Feasibility Study.

FetMRQC: a robust quality control system for multi-centric fetal brain MRI

A robust quality estimation method for medical image segmentation with small datasets

QU-net++: Image Quality Detection Framework for Segmentation of Medical 3D Image Stacks

Deep neural network ensemble for on-the-fly quality control-driven segmentation of cardiac MRI T1 mapping

Comprehensive Clinical Usability-oriented Contour Quality Evaluation for Deep learning Auto-segmentation: Combining Multiple Quantitative Metrics through Machine Learning

A Decoupled Uncertainty Model for MRI Segmentation Quality Estimation

A Novel Quality Control Algorithm for Medical Image Segmentation Based on Fuzzy Uncertainty

TMS-Net: A Segmentation Network Coupled With A Run-time Quality Control Method For Robust Cardiac Image Segmentation

Segmentation Quality and Volumetric Accuracy in Medical Imaging

nnSegNeXt: A 3D Convolutional Network for Brain Tissue Segmentation Based on Quality Evaluation