Hagnifinder: Predicting Magnification of Digital Histological Images Using Deep Learning

Hongtai Zhang,Zaiyi Liu,Mingli Song,Cheng Lu
DOI: https://doi.org/10.2139/ssrn.4132288
2022-01-01
Abstract:Background and Objective: Training a robust cancer diagnostic or prognostic artificial intelligent model using histology images requires a large number of representative cases with labels or annotations, which are difficult to obtain. The histology snapshots available in published papers or case reports could be used to enrich the training dataset. However, the magnifications of these invaluable snapshots are generally unknown, which limits their usage. Therefore, a robust magnification predictor is required for utilizing those diverse snapshot repositories consisting of different diseases. This paper presents a magnification prediction model named Hagnifinder for H&E-stained histological images.Methods: Hagnifinder is a regression model based on a convolutional neural network (CNN) that contains three modules: Feature Extraction Module, Regression Module, and Adaptive Scaling Module (ASM). In the training phase, the Feature Extraction Module first extracts the image features, followed by feature values redistribution performed by the ASM. Finally, the Regression Module estimated the mapping between the extracted features and the magnifications. We constructed a new dataset for training a robust model, named Hagni40, consisting of 94,643 H&E-stained histology image patches at 40 different magnifications of 13 types of cancers based on The Cancer Genome Atlas. To verify the performance of the Hagnifinder, we measured the accuracy of the predictions by setting the maximum allowable difference values (0.5, 1, 5) between the predicted magnification and the actual magnification. We compared Hagnifinder with state-of-the-art methods on a public dataset BreakHis and the Hagni40.Results: The Hagnifinder provides consistent prediction accuracy, with a mean accuracy of 98.9%, across 40 different magnifications and 13 different cancer types when Resnet50 was used as the feature extractor. Compared with the state-of-the-art methods focusing on 4 to 5 levels of magnification classification, the Hagnifinder achieved the best and most comparable performance in BreakHis and Hagni40 datasets. Conclusions: The experimental results suggest that Hagnifinder could be a valuable tool for predicting the associated magnification of any given histology image.
What problem does this paper attempt to address?