CBIDR: A novel method for information retrieval combining image and data by means of TOPSIS applied to medical diagnosis

Humberto Giuri,Renato A. Krohling

2024-09-27

Abstract:Content-Based Image Retrieval (CBIR) have shown promising results in the field of medical diagnosis, which aims to provide support to medical professionals (doctor or pathologist). However, the ultimate decision regarding the diagnosis is made by the medical professional, drawing upon their accumulated experience. In this context, we believe that artificial intelligence can play a pivotal role in addressing the challenges in medical diagnosis not by making the final decision but by assisting in the diagnosis process with the most relevant information. The CBIR methods use similarity metrics to compare feature vectors generated from images using Convolutional Neural Networks (CNNs). In addition to the information contained in medical images, clinical data about the patient is often available and is also relevant in the final decision-making process by medical professionals. In this paper, we propose a novel method named CBIDR, which leverage both medical images and clinical data of patient, combining them through the ranking algorithm TOPSIS. The goal is to aid medical professionals in their final diagnosis by retrieving images and clinical data of patient that are most similar to query data from the database. As a case study, we illustrate our CBIDR for diagnostic of oral cancer including histopathological images and clinical data of patient. Experimental results in terms of accuracy achieved 97.44% in Top-1 and 100% in Top-5 showing the effectiveness of the proposed approach.

Information Retrieval,Artificial Intelligence,Image and Video Processing

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the information retrieval problem of combining images and patients' clinical data in medical diagnosis. Specifically, the existing content - based image retrieval (CBIR) methods have shown good results in medical diagnosis, but these methods mainly rely on the features extracted from images and ignore patients' clinical data. The author believes that by combining images and clinical data, more comprehensive information can be provided to assist doctors in making the final diagnosis, thereby improving the accuracy of diagnosis.

For this purpose, the paper proposes a new method - CBIDR (Content - Based Image and Data Retrieval). This method uses convolutional neural networks (CNN) to extract features from medical images and uses the TOPSIS (Technique for Order Preference by Similarity to Ideal Solution) algorithm to comprehensively rank image features and clinical data in order to find the images and clinical data most similar to the query data. This method aims to assist medical professionals in making the final diagnosis by providing the most relevant images and clinical information, especially in the diagnosis of oral cancer.

The main contributions of the paper include:
1. For the first time, a content - based information retrieval method (CBIDR) that combines images and data through the TOPSIS algorithm is proposed.
2. The CBIDR method is applied to a specific case study, that is, the diagnosis of oral cancer using the NDB - UFES dataset, which contains histopathological images and patients' clinical data, to demonstrate the feasibility and effectiveness of this method.

Through experiments, this method has achieved 97.44% in Top - 1 accuracy and 100% in Top - 5 accuracy, showing its effectiveness and potential in medical diagnosis.