Abstract:Content-based medical image retrieval continues to gain attention for its potential to assist radiological image interpretation and decision making. Many approaches have been proposed to improve the performance of medical image retrieval system, among which visual features such as SIFT, LBP, and intensity histogram play a critical role. Typically, these features are concatenated into a long vector to represent medical images, and thus traditional dimension reduction techniques such as locally linear embedding (LLE), principal component analysis (PCA), or laplacian eigenmaps (LE) can be employed to reduce the "curse of dimensionality". Though these approaches show promising performance for medical image retrieval, the feature-concatenating method ignores the fact that different features have distinct physical meanings. In this paper, we propose a new method called multiview locally linear embedding (MLLE) for medical image retrieval. Following the patch alignment framework, MLLE preserves the geometric structure of the local patch in each feature space according to the LLE criterion. To explore complementary properties among a range of features, MLLE assigns different weights to local patches from different feature spaces. Finally, MLLE employs global coordinate alignment and alternating optimization techniques to learn a smooth low-dimensional embedding from different features. To justify the effectiveness of MLLE for medical image retrieval, we compare it with conventional spectral embedding methods. We conduct experiments on a subset of the IRMA medical image data set. Evaluation results show that MLLE outperforms state-of-the-art dimension reduction methods.

Medical Image Annotation And Retrieval Using Visual Features

Multistage and Multi-features Medical Image Retrieval System

Content-Based Retrieval of Focal Liver Lesions Using Geometrical and Textural Features of Multi-Phase CT-Scan Images

A Retrieval System For 3d Multi-Phase Contrast-Enhanced Ct Images Of Focal Liver Lesions Based On Combined Bags Of Visual Words And Texture Words

Sparse Codebook Model of Local Structures for Retrieval of Focal Liver Lesions Using Multiphase Medical Images

Local Registration of Medical Images Using Feature Point and Intensity Information

Medical Image Retrieval Using Sift Feature

CUHK at ImageCLEF 2005: cross-language and cross-media image retrieval

Retrieving similar cases from the medical literature - the ImageCLEF experience

Learning Based Combining Different Features for Medical Image Retrieval

Feature Annotation for Visual Concept Detection in ImageCLEF 2008.

Medical Image Retrieval Based on Gray Level Co-occurrence Matrix and Gradient Phase Mutual Information

Medical Image Retrieval Based on Nonlinear Texture Features

CUHK Experiments with ImageCLEF 2005.

Multiview Locally Linear Embedding for Effective Medical Image Retrieval.

Using medline queries to generate image retrieval tasks for benchmarking

A Survey on Relevance Feedback Techniques in Content-based Medical Image Retrieval

Overview of the ImageCLEF 2020: Multimedia Retrieval in Medical, Lifelogging, Nature, and Internet Applications

Mutual Information Based Feature Selection for Medical Image Retrieval

Instance-level Medical Image Classification for Text-based Retrieval in a Medical Data Integration Center

Enhancing Medical Image Retrieval with UMLS-Integrated CNN-Based Text Indexing