Abstract:Learning similarity measure from relevance feedback has become a promising way to enhance the image retrieval performance. Existing approaches mainly focus on taking short-term learning experience to identify a visual similarity measure within a single query session, or applying long-term learning methodology to infer a semantic similarity measure crossing multiple query sessions. However, there is still a big room to elevate the retrieval effectiveness, because little is known in taking the relationship between visual similarity and semantic similarity into account. In this paper, we propose a novel hybrid similarity learning scheme to preserve both visual and semantic resemblance by integrating short-term with long-term learning processes. Concretely, the proposed scheme first learns a semantic similarity from the users' query log, and then, taking this as prior knowledge, learns a visual similarity from a mixture of labeled and unlabeled images. In particular, unlabeled images are exploited for the relevant and irrelevant classes differently and the visual similarity is learned incrementally. Finally, a hybrid similarity measure is produced by fusing the visual and semantic similarities in a nonlinear way for image ranking. An empirical study shows that using hybrid similarity measure for image retrieval is beneficial, and the proposed algorithm achieves better performance than some existing approaches.

Learning a hybrid similarity measure for image retrieval.

Learning A Semantic Space from User'S Relevance Feedback for Image Retrieval

Collaborative Learning Between Visual Content and Hidden Semantic for Image Retrieval

Learning similarity for image retrieval with locally spatial information feedback

Hybrid Textual-Visual Relevance Learning for Content-Based Image Retrieval.

Similarity Measure Learning for Image Retrieval Using Feature Subspace Analysis

An Image Retrieval Method Based On Collaborative Filtering

A Novel Semantics-Based Image Retrieval Method Using Similarity Measure of Multi-Level Semantics

Learning Based Combining Different Features for Medical Image Retrieval

Collaborative Similarity Metric Learning for Semantic Image Annotation and Retrieval.

Combining similarity measures in content-based image retrieval guided by mutual information

Improving image retrieval performance by integrating long-term learning with short-term learning

Adaptive tree similarity learning for image retrieval

SVM-Feedback Scheme Within Hybrid Learning Framework for Image Retrieval

Combining long-term learning and active learning with semi-supervised method for content-based image retrieval

Query aware visual similarity propagation for image search reranking.

Learning Discriminative Fisher Kernel for Image Retrieval

Enhancing Relevance Feedback in Image Retrieval Using Unlabeled Data

Web-Based Image Retrieval: A Hybrid Approach

Learning to Combine Ad-hoc Ranking Functions for Image Retrieval

A Novel Approach Supporting Multi-image Queries in Image Retrieval