Abstract:Object retrieval aims at retrieving images containing objects similar to the query object captured in the region of interest (ROI) of the query image. Boosted by the invention and wide popularity of SIFT image features and bag-of-visual-words image representation, object retrieval has progressed significantly in the past years and has already found deployment in real-life applications and products. While existing object retrieval methods perform well in many cases, they may fail to return satisfactory results if the ROI specified by the user is inaccurate or if the object captured there is too small to be represented using discriminative features and consequently to be matched with similar objects in the image collection. In order to improve the object retrieval performance also in these difficult cases, we propose in this paper an object retrieval method that exploits the information about the visual context of the query object and employ it to compensate for possible uncertainty in feature-based query object representation. Contextual information is drawn from the visual elements surrounding the query object in the query image. We consider the ROI as an uncertain observation of the latent search intent and the saliency map detected for the query image as a prior. Then a language modeling approach is employed to devise a contextual object retrieval (COR) model. There, the relevance score is determined based on the search intent scores that are inferred from the uncertain ROI and the saliency prior. The usefulness of the contextual information for object retrieval and the effectiveness of the proposed COR model are demonstrated and evaluated on three representative image datasets.

Visual Object Localization in Image Collections

Exploiting Context Aware Category Discovery for Image Labeling.

Weakly-supervised Object Localization in Unlabeled Image Collection.

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

Object Categorization Using Local Feature Context.

Concurrent Segmentation of Categorized Objects from an Image Collection.

Two-Stage Localization For Image Labeling

Large-Scale Weakly Supervised Object Localization Via Latent Category Learning

Unsupervised Salient Object Segmentation From Color Images

Unsupervised Object Discovery Via Object-Centric Representation

Detection and Segmentation of Unlearned Objects in Unknown Environment

Mining Objects: Fully Unsupervised Object Discovery and Localization from a Single Image.

Discovering objects and their location in videos using spatial-temporal context words

Object Localization Based on Natural Language Descriptions for Fine-Grained Image

Object Categorization Using Context from Multi-Spatial Levels

Semantically Modeling of Object and Context for Categorization

Self-Supervised Object Localization with Joint Graph Partition

Learning Local Features with Context Aggregation for Visual Localization

Object retrieval using configurations of salient regions

Object Retrieval Using Visual Query Context

Object Discovery from a Single Unlabeled Image by Mining Frequent Itemsets with Multi-Scale Features.