Abstract:Most effective particular object and image retrieval approaches are based on the bag-of-words (BoW) model, and all state-of-the-art performance mainly involves a query expansion procedure, which is able to significantly improve retrieval results. Nowadays, Convolutional Neural Network(CNN) is widely applied in computer vision field, including image classification, caption, recognition and retrieval, etc. We introduce an extension to query expansion: an automatic method to select good candidate samples for interactive annotation which is used in query expansion using both BoW method and CNN feature. In this work, we address the query expansion framework using active learning, where the main focus is on the sample selection step in the process of query expansion. More specifically, we propose an active sample selection algorithm based on binary relevance classification, based on the assumption that most confusing samples of the classifiers have high probability to contain helpful true positives for query expansion, which significantly improves the retrieval performance. It takes full use of the multimodal information of the shortlist obtained from the basic retrieval to train a binary relevance classifier, which is used to pick up the most confusing samples for human annotation, with top list as unlabeled data and bottom list as fake negatives. And it can achieve a faster and better retrieval than naive top sample selection method. We also fuse BoW vector and CNN prediction in the retrieval system for a better performance. To evaluate the performance of our proposed method, experiments are conducted on Standard Oxford (5K and 105K) and Paris (6K) datasets, and experimental results and comparison with the state-of-the-art methods demonstrate the effectiveness of the proposed method.

Machine Learning Based Query Expansion in Blog Retrieval

A Semantic Query Expansion-Based Patent Retrieval Approach

Exploiting Semantic Knowledge Base for Patent Retrieval

Domain Lexicon-Based Query Expansion for Patent Retrieval

Probabilistic Query Expansion Using Query Logs

Learning with Both Unlabeled Data and Query Logs for Image Search.

Bagging to find better expansion words

Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering.

Query expansion enhancement by fast binary matching.

Query Expansion for Short Queries by Mining User Logs

A patent retrieval method based on automatic query expansion

Query Expansion by Mining User Logs

Concept based query expansion using hidden markov model

Feedback Model for Microblog Retrieval.

Query Expansion for Object Retrieval with Active Learning Using BoW and CNN Feature

MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion

Query expansion based on Web knowledge base and search engine

Concept Based Query and Document Expansion Using Hidden Markov Model

Query Expansion Based on Clustered Results

Query Expansion by Spatial Co-Occurrence for Image Retrieval

Exploring the Best Practices of Query Expansion with Large Language Models