Deep Encoding Features For Instance Retrieval

Zhiming Ding,Zhengzhong Zhou,Liqing Zhang
DOI: https://doi.org/10.1007/978-3-319-70090-8_7
2017-01-01
Abstract:In this paper, we propose a novel approach for instance retrieval. Compared with traditional retrieval pipeline, we first locate several candidate regions of target object with a region proposal network (RPN), instead of exhausting sliding window method. The candidate regions are detected through the trained RPN. Then we obtain the region-wise convolutional feature maps (CFMs) by forwarding them through a ROI pooling layer. Our feature encoding representation builds on the common sense that similar patterns have similar activations on feature maps. The target object is regarded as a combination of several meaningful patterns. In this way, we represent an image with the combination of encoded descriptors corresponding to the subsets of the proposed region. We also implement reranking algorithm to refine the proposed region in local retrieval. Through extensive experiments, we demonstrate the suitability of our feature encoding representation for instance retrieval, achieving comparable performance on both Oxford and Paris buildings benchmarks.
What problem does this paper attempt to address?