Abstract:While content-based image annotation and retrieval have been active research topics over the past decade, their correlation is not well exploited until recently. We argue that offline annotation and online retrieval models should be regarded as a unified long-term learner to reinforce each other. Based on this viewpoint, this paper presents an annotation-retrieval reinforcement framework, in which a dual-structured learning model is presented: the keyword-image association is learned by semantic manifold modeling while the semantic correlation between keywords is learned by Image-Word Net modeling. In keyword-image association modeling level, to effectively model keyword-image manifold, we present a manifold co-training algorithm to address the sample insufficiency problem. In manifold-based image annotation, we view annotation process as semantic feature reduction in keyword space, based on which a Biased Fisher Discriminant Analysis (BFDA) algorithm is presented for Eigen feature (keyword) selection. In semantic correlation modeling level, a novel Image-Word Net is learned from annotation training set and users' retrieval log for (1) irrelevant annotated keyword pruning; (2) semantic-level retrieval enhancement. In retrieval, our framework can effectively reveal user target by improving traditional content-based relevance feedback to linguistic-level interaction using annotation information, based on which BFDA is adopted for keyword selection. Finally, user interaction logs are adopted for manifold model updating and annotation refinement. As presented in our experiments, proposed method outperforms state-of-the-art annotation and retrieval algorithms in COREL Image databases with over 10,000 general-purpose images.

Manifold-Ranking-Based Keyword Propagation for Image Retrieval

Learning an Image Manifold for Retrieval

Multi-Modal Web Image Retrieval Using Manifold-Ranking

Generalized Manifold-Ranking-Based Image Retrieval

Improving Image Annotation Via Ranking-Oriented Neighbor Search and Learning-Based Keyword Propagation

Annotation-retrieval reinforcement by visual cognition modeling on manifold.

Relevance Feedback For Keyword And Visual Feature-Based Image Retrieval

Multi-Manifold Ranking: Using Multiple Features for Better Image Retrieval.

A unified framework for image retrieval using keyword and visual features

Cross-media Manifold Learning for Image Retrieval & Annotation

Semantically Coherent Image Annotation with a Learning-Based Keyword Propagation Strategy.

Boosting Manifold Ranking for Image Retrieval by Mining Query Log Repeatedly

Incorporating Manifold Ranking with Active Learning in Relevance Feedback for Image Retrieval

Efficient Manifold Ranking for Image Retrieval

An Image Retrieval Algorithm Based On Reselect Manifold Ranking

Integrated Manifold Ranking and Region Matching for Image Retrieval

MultiVCRank with Applications to Image Retrieval.

A Novel Ranking Algorithm Based on Manifold Learning for CBIR System

State-of-the-Art on Image Retrieval Based on Manifold Learning

Image retrieval based on reselect manifold ranking

A Self-immunizing Manifold Ranking for Image Retrieval.