Abstract:Image search reranking and image research result summarization are two effective approaches which enhance text-based image search results using visual information. Since the existing approaches optimize search relevance in terms of average performance, they usually cannot achieve satisfactory results for some particular classes of queries, like “object queries,” which is defined as the queries with the intent of searching for some kinds of objects. One possible reason is that the generic approaches such as , , are mostly built based on the global statistics of images as features while ignoring the fact that the relevance between the image and the query sometimes depends on an image patch instead of the whole image. In this paper, we therefore design a novel bag-of-object retrieval model to predict image relevance, which is particularly effective for object queries. First, we construct an object vocabulary containing query-relative objects by mining frequent object patches from the result image collection of the expanded query set. After representing each image as a bag of objects, our retrieval model can be derived from a risk-minimization framework for language modeling. To demonstrate the effectiveness of the proposed model, this paper also present two related applications: for image search reranking, we adopt a supervised framework to combine multiple ranking features from different assumptions; for image search result summarization, we propose a two-step ranking process which optimizes not only representativeness but also image attractiveness. The experimental results show that the proposed methods can significantly outperform the existing approaches.

Improving the image retrieval results via topic coverage graph

Diversifying the image retrieval results.

Contextual Modeling on Auxiliary Points for Robust Image Reranking

Clickthrough Refinement for Improved Graph Ranking

Image Search Reranking with Hierarchical Topic Awareness.

A Graphic-Theoretic Model for Incremental Relevance Feedback in Image Retrieval

A Rich Get Richer Strategy For Content-Based Image Retrieval

Graph-Based Features for Image Retrieval

Building a Compact Relevant Sample Coverage for Relevance Feedback in Content-Based Image Retrieval

Object Retrieval with Image Graph Traversal-Based Re-Ranking

Node-Sensitive Graph Fusion via Topo-Correlation for Image Retrieval

Diversified Spatial Keyword Query on Topic Coverage

Exploration of Image Search Results Quality Assessment

Assessing Image Retrieval Quality at the First Glance

Relevance Feedback: a Power Tool for Interactive Content-Based Image Retrieval

Rank-Aware Graph Fusion With Contextual Dissimilarity Measurement For Image Retrieval

Improving Retrieval Performance by Region Constraints and Relevance Feedback

Relevance Feedback Techniques In Interactive Content-Based Image Retrieval

Image Relevance Prediction Using Query-Context Bag-of-Object Retrieval Model

A unified optimization based learning method for image retrieval

Adaptively Weighted Graph Fusion for Image Retrieval.