Abstract:Object retrieval aims at retrieving images containing objects similar to the query object captured in the region of interest (ROI) of the query image. Boosted by the invention and wide popularity of SIFT image features and bag-of-visual-words image representation, object retrieval has progressed significantly in the past years and has already found deployment in real-life applications and products. While existing object retrieval methods perform well in many cases, they may fail to return satisfactory results if the ROI specified by the user is inaccurate or if the object captured there is too small to be represented using discriminative features and consequently to be matched with similar objects in the image collection. In order to improve the object retrieval performance also in these difficult cases, we propose in this paper an object retrieval method that exploits the information about the visual context of the query object and employ it to compensate for possible uncertainty in feature-based query object representation. Contextual information is drawn from the visual elements surrounding the query object in the query image. We consider the ROI as an uncertain observation of the latent search intent and the saliency map detected for the query image as a prior. Then a language modeling approach is employed to devise a contextual object retrieval (COR) model. There, the relevance score is determined based on the search intent scores that are inferred from the uncertain ROI and the saliency prior. The usefulness of the contextual information for object retrieval and the effectiveness of the proposed COR model are demonstrated and evaluated on three representative image datasets.

Object-Based Image Retrieval Using Spatial Context

Fast and Robust Spatial Matching for Object Retrieval

Semantics Retrieval by Fuzzy Spatial Context of Image Objects

A Context Model for Object Recognition Improved by Spatial Relationships

Object Retrieval Using Visual Query Context

Fast Object Retrieval Using Direct Spatial Matching

Object Recognition Based on Improved Context Model

Creating the Bag-of-Words with Spatial Context Information for Image Retrieval

Encoding Spatial Context for Large-Scale Partial-Duplicate Web Image Retrieval

Spatially aware feature selection and weighting for object retrieval

ROI Image Retrieval Based on the Spatial Structure of Objects

Object retrieval using configurations of salient regions

Visual Vocabulary Optimization with Spatial Context for Image Annotation and Classification

Spatial context for visual vocabulary construction

Contextual Hashing for Large-Scale Image Search.

An Image Retrieval Combining Color and Spatial Information

Context Based Re-Ranking For Object Retrieval

Image Classification by Exploiting the Spatial Context Information

Image Retrieval Based on Objects' Spatial Orientation Relationships

Object-Based Image Retrieval With Attention Analysis And Spatial Re-Ranking

A New Approach for Image Retrieval Based on Color and Spatial Features