CoTCoNet: An Optimized Coupled Transformer-Convolutional Network with an Adaptive Graph Reconstruction for Leukemia Detection

Chandravardhan Singh Raghaw,Arnav Sharma,Shubhi Bansal,Mohammad Zia Ur Rehman,Nagendra Kumar

DOI: https://doi.org/10.1016/j.compbiomed.2024.108821

2024-10-21

Abstract:Swift and accurate blood smear analysis is an effective diagnostic method for leukemia and other hematological malignancies. However, manual leukocyte count and morphological evaluation using a microscope is time-consuming and prone to errors. Conventional image processing methods also exhibit limitations in differentiating cells due to the visual similarity between malignant and benign cell morphology. This limitation is further compounded by the skewed training data that hinders the extraction of reliable and pertinent features. In response to these challenges, we propose an optimized Coupled Transformer Convolutional Network (CoTCoNet) framework for the classification of leukemia, which employs a well-designed transformer integrated with a deep convolutional network to effectively capture comprehensive global features and scalable spatial patterns, enabling the identification of complex and large-scale hematological features. Further, the framework incorporates a graph-based feature reconstruction module to reveal the hidden or unobserved hard-to-see biological features of leukocyte cells and employs a Population-based Meta-Heuristic Algorithm for feature selection and optimization. To mitigate data imbalance issues, we employ a synthetic leukocyte generator. In the evaluation phase, we initially assess CoTCoNet on a dataset containing 16,982 annotated cells, and it achieves remarkable accuracy and F1-Score rates of 0.9894 and 0.9893, respectively. To broaden the generalizability of our model, we evaluate it across four publicly available diverse datasets, which include the aforementioned dataset. This evaluation demonstrates that our method outperforms current state-of-the-art approaches. We also incorporate an explainability approach in the form of feature visualization closely aligned with cell annotations to provide a deeper understanding of the framework.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper attempts to address several key challenges in the detection of acute lymphoblastic leukemia (ALL):

1. **Limitations of Manual Analysis**: Traditional leukemia diagnosis methods rely on manual counting and morphological assessment under a microscope, which is not only time-consuming but also prone to errors.

2. **Data Imbalance Issue**: Training datasets often exhibit class imbalance, making it difficult to extract reliable features and affecting the model's generalization ability.

3. **Complexity of Feature Extraction**: Existing methods struggle to distinguish between malignant and benign cells when processing cell images, especially when the cell morphologies are similar.

4. **Fusion of Global and Local Features**: Current methods often focus only on local or global features, failing to effectively combine both, resulting in poor classification performance.

To address these issues, the authors propose an optimized Coupled Transformer Convolutional Network (CoTCoNet) framework, which aims to improve the accuracy and efficiency of leukemia detection through the following approaches:

- **Coupling Transformer and Convolutional Networks**: Combining the strengths of transformers and convolutional networks to capture both global and local features, enhancing the recognition of complex and large-scale hematological features.
- **Graph-Based Feature Reconstruction Module**: Revealing hidden biological features through graph structures to enhance the model's feature extraction capability.
- **Synthetic White Blood Cell Generator**: Generating synthetic white blood cell samples to alleviate the data imbalance issue.
- **Feature Selection and Optimization**: Using population-based metaheuristic algorithms for feature selection and optimization, reducing data dimensionality while retaining key features.

Through these innovations, the CoTCoNet framework was extensively evaluated on 4 different datasets, and the results showed that it significantly outperformed existing methods in terms of accuracy and F1 score.