Abstract:Background and objective: The classification of bone marrow (BM) cells by light microscopy is an important cornerstone of hematological diagnosis, performed thousands of times a day by highly trained specialists in laboratories worldwide. As the manual evaluation of blood or BM smears is very time-consuming and prone to inter-observer variation, new reliable automated systems are needed. Methods: We aim to improve the automatic classification performance of hematological cell types. Therefore, we evaluate four state-of-the-art Convolutional Neural Network (CNN) architectures on a dataset of 171,374 microscopic cytological single-cell images obtained from BM smears from 945 patients diagnosed with a variety of hematological diseases. We further evaluate the effect of an in-domain vs. out-of-domain pre-training, and assess whether class activation maps provide human-interpretable explanations for the models' predictions. Results: The best performing pre-trained model (Regnet_y_32gf) yields a mean precision, recall, and F1 scores of 0.787±0.060, 0.755±0.061, and 0.762±0.050, respectively. This is a 53.5% improvement in precision and 7.3% improvement in recall over previous results with CNNs (ResNeXt-50) that were trained from scratch. The out-of-domain pre-training apparently yields general feature extractors/filters that apply very well to the BM cell classification use case. The class activation maps on cell types with characteristic morphological features were found to be consistent with the explanations of a human domain expert. For example, the Auer rods in the cytoplasm were the predictive cellular feature for correctly classified images of faggot cells. Conclusions: Our study provides data that can help hematology laboratories to choose the optimal training strategy for blood cell classification deep learning models to improve computer-assisted blood and bone marrow cell identification. It also highlights the need for more specific training data, i.e. images of difficult-to-classify classes, including cells labeled with disease information.

Optimizations of Autoencoders for Analysis and Classification of Microscopic In Situ Hybridization Images

Supervised and Unsupervised End-to-End Deep Learning for Gene Ontology Classification of Neural In Situ Hybridization Images

AIMIC: Deep Learning for Microscopic Image Classification

A Deep Learning-based Compression and Classification Technique for Whole Slide Histopathology Images

Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology

Artefact removal in ground truth and noise model deficient sub-cellular nanoscopy images using auto-encoder deep learning

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Deep Learning Microscopy

Deep learning-based image analysis for in situ microscopic imaging of cell culture process

Contrastive Deep Encoding Enables Uncertainty-aware Machine-learning-assisted Histopathology

Evolving Deep Convolutional Neural Networks for Image Classification

Blind microscopy image denoising with a deep residual and multiscale encoder/decoder network

Neural Network for Enhancing Microscopic Resolution Based on Images from Scanning Electron Microscope

Supervised Dimensionality Reduction and Image Classification Utilizing Convolutional Autoencoders

Autoencoders as Weight Initialization of Deep Classification Networks for Cancer versus Cancer Studies

Scalable deep learning artificial intelligence histopathology slide analysis and validation

Deep Learning for Size and Microscope Feature Extraction and Classification in Oral Cancer: Enhanced Convolution Neural Network

Deep Learning Neural Network for Lung Cancer Classification: Enhanced Optimization Function

Roadmap on Deep Learning for Microscopy

Evaluation of deep learning training strategies for the classification of bone marrow cell images

A comparative Analysis of Image Enhancement Using Autoencoders and Generative Adversarial Networks