Abstract:Most effective particular object and image retrieval approaches are based on the bag-of-words (BoW) model, and all state-of-the-art performance mainly involves a query expansion procedure, which is able to significantly improve retrieval results. Nowadays, Convolutional Neural Network(CNN) is widely applied in computer vision field, including image classification, caption, recognition and retrieval, etc. We introduce an extension to query expansion: an automatic method to select good candidate samples for interactive annotation which is used in query expansion using both BoW method and CNN feature. In this work, we address the query expansion framework using active learning, where the main focus is on the sample selection step in the process of query expansion. More specifically, we propose an active sample selection algorithm based on binary relevance classification, based on the assumption that most confusing samples of the classifiers have high probability to contain helpful true positives for query expansion, which significantly improves the retrieval performance. It takes full use of the multimodal information of the shortlist obtained from the basic retrieval to train a binary relevance classifier, which is used to pick up the most confusing samples for human annotation, with top list as unlabeled data and bottom list as fake negatives. And it can achieve a faster and better retrieval than naive top sample selection method. We also fuse BoW vector and CNN prediction in the retrieval system for a better performance. To evaluate the performance of our proposed method, experiments are conducted on Standard Oxford (5K and 105K) and Paris (6K) datasets, and experimental results and comparison with the state-of-the-art methods demonstrate the effectiveness of the proposed method.

Bagging to find better expansion words

Query Expansion with Statistical Machine Translation

A context-dependent approach to query expansion in information retrieval

Machine Learning Based Query Expansion in Blog Retrieval

Learning for Efficient Supervised Query Expansion Via Two-stage Feature Selection

Social Annotation for Query Expansion Learning from Multiple Expansion Strategies

Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering.

Query Expansion Based on Semantics and Statistics in Chinese Question Answering System

Query Expansion Model Based on Semi-Supervised Learning

Improve Diversity-oriented Biomedical Information Retrieval Using Supervised Query Expansion

A Statistical Query Expansion Model Based on Query Logs

Query Expansion by Spatial Co-Occurrence for Image Retrieval

Improving Query Expansion Using WordNet

SQE-GAN: A Supervised Query Expansion Scheme via GAN.

Concept Based Query Expansion Using Wordnet

Social annotation in query expansion: a machine learning approach.

Query Expansion Using A Collection Dependent Probabilistic Latent Semantic Thesaurus

Improving Pseudo-Relevance Feedback with Neural Network-Based Word Representations

Query Expansion Based on Query Log and Small World Characteristic

A Survey on Query Expansion Based on Local Analysis

Query Expansion for Object Retrieval with Active Learning Using BoW and CNN Feature