Abstract:While content-based image annotation and retrieval have been active research topics over the past decade, their correlation is not well exploited until recently. We argue that offline annotation and online retrieval models should be regarded as a unified long-term learner to reinforce each other. Based on this viewpoint, this paper presents an annotation-retrieval reinforcement framework, in which a dual-structured learning model is presented: the keyword-image association is learned by semantic manifold modeling while the semantic correlation between keywords is learned by Image-Word Net modeling. In keyword-image association modeling level, to effectively model keyword-image manifold, we present a manifold co-training algorithm to address the sample insufficiency problem. In manifold-based image annotation, we view annotation process as semantic feature reduction in keyword space, based on which a Biased Fisher Discriminant Analysis (BFDA) algorithm is presented for Eigen feature (keyword) selection. In semantic correlation modeling level, a novel Image-Word Net is learned from annotation training set and users' retrieval log for (1) irrelevant annotated keyword pruning; (2) semantic-level retrieval enhancement. In retrieval, our framework can effectively reveal user target by improving traditional content-based relevance feedback to linguistic-level interaction using annotation information, based on which BFDA is adopted for keyword selection. Finally, user interaction logs are adopted for manifold model updating and annotation refinement. As presented in our experiments, proposed method outperforms state-of-the-art annotation and retrieval algorithms in COREL Image databases with over 10,000 general-purpose images.

EXPLOITING IMAGE ANNOTATION AND KEYWORD RETRIEVAL LOGS FOR CBIR, FROM KEYWORD CATEGORIZATION ASPECT

A Long-Term Learning Algorithm in CBIR Based on Log-Analyzing

Image Annotation by Large-Scale Content-Based Image Retrieval

A unified framework for image retrieval using keyword and visual features

Content-based image retrieval system with new low-level features, new similarity metric, and novel feedback learning

A Comprehensive Analysis for Relevance Feedback in CBIR System.

Relevance Feedback: a Power Tool for Interactive Content-Based Image Retrieval

Exploiting Unlabeled Data In Content-Based Image Retrieval

A Novel Retrieval Refinement and Interaction Pattern by Exploring Result Correlations for Image Retrieval

An Analogy-Relevance Feedback Cbir Method Using Multiple Features

Annotation-retrieval reinforcement by visual cognition modeling on manifold.

Relevance feedback: A power tool for interactive content-based image retrieval.

Improving Image Annotation Via Ranking-Oriented Neighbor Search and Learning-Based Keyword Propagation

Relevance Feedback Techniques In Interactive Content-Based Image Retrieval

Relevance Feedback Based on Query Refining and Feature Database Updating in CBIR System

An active feedback framework for image retrieval

Efficient Image-Text Retrieval via Keyword-Guided Pre-Screening

A Relevance Feedback System for CBIR with Long-Term Learning

Content-based Image Retrieval Using Optimal Feature Combination and Relevance Feedback

Image Retrieval Method Using Visual Query Suggestion and Relevance Feedback

An Anamnestic Semantic Tree-Based Relevance Feedback Method in CBIR System