Abstract:Image search reranking and image research result summarization are two effective approaches which enhance text-based image search results using visual information. Since the existing approaches optimize search relevance in terms of average performance, they usually cannot achieve satisfactory results for some particular classes of queries, like “object queries,” which is defined as the queries with the intent of searching for some kinds of objects. One possible reason is that the generic approaches such as , , are mostly built based on the global statistics of images as features while ignoring the fact that the relevance between the image and the query sometimes depends on an image patch instead of the whole image. In this paper, we therefore design a novel bag-of-object retrieval model to predict image relevance, which is particularly effective for object queries. First, we construct an object vocabulary containing query-relative objects by mining frequent object patches from the result image collection of the expanded query set. After representing each image as a bag of objects, our retrieval model can be derived from a risk-minimization framework for language modeling. To demonstrate the effectiveness of the proposed model, this paper also present two related applications: for image search reranking, we adopt a supervised framework to combine multiple ranking features from different assumptions; for image search result summarization, we propose a two-step ranking process which optimizes not only representativeness but also image attractiveness. The experimental results show that the proposed methods can significantly outperform the existing approaches.

Object-Based Image Retrieval With Attention Analysis And Spatial Re-Ranking

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Spatial Consistency Based Selective Reranking for Content Based Object Retrieval.

Fast Object Retrieval Using Direct Spatial Matching

Saliency oriented object image re-ranking

Object Retrieval with Image Graph Traversal-Based Re-Ranking

Multi-Query Parallel Field Ranking for image retrieval.

Object-Based Image Retrieval Using Spatial Context

Context Based Re-Ranking For Object Retrieval

Object retrieval using configurations of salient regions

A bag-of-objects retrieval model for web image search.

An Object-Level Feature Representation Model for the Multi-target Retrieval of Remote Sensing Images.

An Adaptive Query Prototype Modeling Method for Image Search Reranking

Deep Spatial Attention Hashing Network for Image Retrieval.

A Flower Image Retrieval Method Based on ROI Feature

End-to-end Semantic-Aware Object Retrieval Based on Region-Wise Attention

Attention Model Based SIFT Keypoints Filtration for Image Retrieval

A Novel and Adaptive Method for Image Search Reranking

A Novel Region-Based Image Retrieval Method Using Relevance Feedback

Image Relevance Prediction Using Query-Context Bag-of-Object Retrieval Model

Region-Based Image Retrieval Revisited