Abstract:Deep learning has made significant strides in automated brain tumor segmentation from magnetic resonance imaging (MRI) scans in recent years. However, the reliability of these tools is hampered by the presence of poor-quality segmentation outliers, particularly in out-of-distribution samples, making their implementation in clinical practice difficult. Therefore, there is a need for quality control (QC) to screen the quality of the segmentation results. Although numerous automatic QC methods have been developed for segmentation quality screening, most were designed for cardiac MRI segmentation, which involves a single modality and a single tissue type. Furthermore, most prior works only provided subject-level predictions of segmentation quality and did not identify erroneous parts segmentation that may require refinement. To address these limitations, we proposed a novel multi-task deep learning architecture, termed QCResUNet, which produces subject-level segmentation-quality measures as well as voxel-level segmentation error maps for each available tissue class. To validate the effectiveness of the proposed method, we conducted experiments on assessing its performance on evaluating the quality of two distinct segmentation tasks. First, we aimed to assess the quality of brain tumor segmentation results. For this task, we performed experiments on one internal and two external datasets. Second, we aimed to evaluate the segmentation quality of cardiac Magnetic Resonance Imaging (MRI) data from the Automated Cardiac Diagnosis Challenge. The proposed method achieved high performance in predicting subject-level segmentation-quality metrics and accurately identifying segmentation errors on a voxel basis. This has the potential to be used to guide human-in-the-loop feedback to improve segmentations in clinical settings.

Re-Thinking Classification Confidence with Model Quality Quantification

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

Evaluating and Boosting Uncertainty Quantification in Classification

Revisiting Confidence Estimation: Towards Reliable Failure Prediction

Towards More Reliable Confidence Estimation

Confidence Estimation Using Unlabeled Data

DECODE: Deep Confidence Network for Robust Image Classification

R-MSSIM: Image quality assessment while performing object detection

How Quality Affects Deep Neural Networks in Fine-Grained Image Classification

QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Prediction

Confidence-Aware Calibration and Scoring Functions for Curriculum Learning

Being Aware of Localization Accuracy By Generating Predicted-IoU-Guided Quality Scores

Uncertainty Quantification in Deep Neural Networks through Statistical Inference on Latent Space

Quantifying Sensing Quality of Crowd Sensing Networks with Confidence Interval

Rethinking Confidence Calibration for Failure Prediction

PQA-Net: Deep No Reference Point Cloud Quality Assessment via Multi-View Projection

Advanced confidence methods in deep learning

A Novel Quality Control Algorithm for Medical Image Segmentation Based on Fuzzy Uncertainty

DeepQA: Improving the estimation of single protein model quality with deep belief networks

Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics