Improving Interpretability of Leucocyte Classification with Multimodal Network

Manon Chossegros,Xavier Tannier,Daniel Stockholm
DOI: https://doi.org/10.3233/SHTI240602
2024-08-22
Abstract:White blood cell classification plays a key role in the diagnosis of hematologic diseases. Models can perform classification either from images or based on morphological features. Image-based classification generally yields higher performance, but feature-based classification is more interpretable for clinicians. In this study, we employed a Multimodal neural network to classify white blood cells, utilizing a combination of images and morphological features. We compared this approach with image-only and feature-only training. While the highest performance was achieved with image-only training, the Multimodal model provided enhanced interpretability by the computation of SHAP values, and revealed crucial morphological features for biological characterization of the cells.
What problem does this paper attempt to address?