Abstract:With great potential for assisting radiological image interpretation and decision making, content-based image retrieval in the medical domain has become a hot topic in recent years. Many methods to enhance the performance of content-based medical image retrieval have been proposed, among which the relevance feedback (RF) scheme is one of the most promising. Given user feedback information, RF algorithms interactively learn a user's preferences to bridge the "semantic gap" between low-level computerized visual features and high-level human semantic perception and thus improve retrieval performance. However, most existing RF algorithms perform in the original high-dimensional feature space and ignore the manifold structure of the low-level visual features of images. In this paper, we propose a new method, termed dual-force ISOMAP (DFISOMAP), for content-based medical image retrieval. Under the assumption that medical images lie on a low-dimensional manifold embedded in a high-dimensional ambient space, DFISOMAP operates in the following three stages. First, the geometric structure of positive examples in the learned low-dimensional embedding is preserved according to the isometric feature mapping (ISOMAP) criterion. To precisely model the geometric structure, a reconstruction error constraint is also added. Second, the average distance between positive and negative examples is maximized to separate them; this margin maximization acts as a force that pushes negative examples far away from positive examples. Finally, the similarity propagation technique is utilized to provide negative examples with another force that will pull them back into the negative sample set. We evaluate the proposed method on a subset of the IRMA medical image dataset with a RF-based medical image retrieval framework. Experimental results show that DFISOMAP outperforms popular approaches for content-based medical image retrieval in terms of accuracy and stability.

Qdfa: Query-Dependent Feature Aggregation For Medical Image Retrieval

Query Dependent Multiview Features Fusion for Effective Medical Image Retrieval

M-DFNet

Learning Based Combining Different Features for Medical Image Retrieval

Medical Image Retrieval with Query-Dependent Feature Fusion Based on One-Class SVM

Democratic Diffusion Aggregation for Image Retrieval

Question-guided Feature Pyramid Network for Medical Visual Question Answering

Fast Democratic Aggregation and Query Fusion for Image Search.

Multi-Query Parallel Field Ranking for image retrieval.

Dual-force ISOMAP: a new relevance feedback method for medical image retrieval

DAug: Diffusion-based Channel Augmentation for Radiology Image Retrieval and Classification

Image retrieval based on aggregated deep features weighted by regional significance and channel sensitivity

DCAFuse: Dual-Branch Diffusion-CNN Complementary Feature Aggregation Network for Multi-Modality Image Fusion

Combating Ambiguity for Hash-Code Learning in Medical Instance Retrieval

QGFormer: Queries-guided transformer for flexible medical image synthesis with domain missing

Adaptive Feature Aggregation Based Multi-Task Learning for Uncertainty-Guided Semi-Supervised Medical Image Segmentation

Multi-center Convolutional Descriptor Aggregation for Image Retrieval.

Multi-modal Multi-relational Feature Aggregation Network for Medical Knowledge Representation Learning

Cascaded Feature Augmentation With Diffusion For Image Retrieval

FedGrav: An Adaptive Federated Aggregation Algorithm for Multi-institutional Medical Image Segmentation

FFLDGA-Net: Image retrieval method based on Feature Fusion Learnable Descriptor Graph Attention Network