Abstract:Grading precancerous lesions on whole slide images is a challenging task: the continuous space of morphological phenotypes makes clear-cut decisions between different grades often difficult, leading to low inter- and intra-rater agreements. More and more Artificial Intelligence (AI) algorithms are developed to help pathologists perform and standardize their diagnosis. However, those models can render their prediction without consideration of the ambiguity of the classes and can fail without notice which prevent their wider acceptance in a clinical context. In this paper, we propose a new score to measure the confidence of AI models in grading tasks. Our confidence score is specifically adapted to ordinal output variables, is versatile and does not require extra training or additional inferences nor particular architecture changes. Comparison to other popular techniques such as Monte Carlo Dropout and deep ensembles shows that our method provides state-of-the art results, while being simpler, more versatile and less computationally intensive. The score is also easily interpretable and consistent with real life hesitations of pathologists. We show that the score is capable of accurately identifying mispredicted slides and that accuracy for high confidence decisions is significantly higher than for low-confidence decisions (gap in AUC of 17.1% on the test set). We believe that the proposed confidence score could be leveraged by pathologists directly in their workflow and assist them on difficult tasks such as grading precancerous lesions.

Confidence Score for Unsupervised Foreground Background Separation of Document Images

An Iterative Refinement Framework for Image Document Binarization with Bhattacharyya Similarity Measure

A Local-to-Global Approach for Document Image Binarization

Adaptive degraded document image binarization

Unsupervised Deep Context Prediction for Background Foreground Separation

Image Decomposition Using a Robust Regression Approach

Unsupervised ensemble of experts (EoE) framework for automatic binarization of document images

A Novel Binarization System for Degraded Document Images.

An enhanced binarization framework for degraded historical document images

Simple and Efficient Confidence Score for Grading Whole Slide Images

A Fast Adaptive Binarization Method Based on Sub Block OSTU and Improved Sauvola

Learning Complementary Saliency Priors for Foreground Object Segmentation in Complex Scenes

Screen Content Image Segmentation Using Robust Regression and Sparse Decomposition

Dynamic Background Estimation and Complementary Learning for Pixel-Wise Foreground/background Segmentation

AdOtsu: An adaptive and parameterless generalization of Otsu's method for document image binarization

A Fair Evaluation of Various Deep Learning-Based Document Image Binarization Approaches

Automatic Object Cosegmentation In Sparse Multiview Images

Saliency Detection Using Two-Stage Scoring

Automatic Document Image Binarization using Bayesian Optimization

A New Local Adaptive Thresholding Technique in Binarization

Enhanced figure-ground classification with background prior propagation.