CovidSafe: A Deep Learning Framework for Covid Detection Using Multi-modal Approach

Routhu, Srinivasa Rao
DOI: https://doi.org/10.1007/s00354-024-00289-8
2024-12-04
New Generation Computing
Abstract:This work introduces CovidSafe, a framework designed to classify COVID patients as positive or negative based on CXR images. With the global impact of COVID-19, there is a need for effective tools to aid in patient diagnosis. CovidSafe utilizes a multi-model deep feature extractor, combining features from the ResNet family and an Auto-Encoder. The ResNet 18, ResNet 34, and ResNet 50 architectures are employed, with model weights fine-tuned for optimal performance. The framework leverages these ResNet models and the Auto-Encoder to extract relevant features. Features from intermediate layers of the ResNet models are extracted to capture increasingly complex and high-level information, while bottleneck features from the Auto-Encoder capture compressed, abstract representations and important characteristics of the images for classification. These features are then used for analysis and classification within the CovidSafe framework. To ensure accessibility for online users, the model is integrated into a web application. Through experimental analysis, the performance of the model is evaluated using various metrics. Results indicate that CovidSafe outperforms baseline models, achieving a precision of 98.67%, a recall of 98.62%, and an F1-score of 98.64%. These promising results highlight the efficacy of CovidSafe in accurately classifying COVID patients based on CXR images, making it a valuable diagnostic tool.
computer science, theory & methods, hardware & architecture
What problem does this paper attempt to address?