Abstract:Our goal is to boost text-based image search results via image reranking. There are diverse modalities (features) of images that we can leverage for reranking, however, the effects of different modalities are query-dependent. The primary challenge we face is how to fuse multiple modalities adaptively for different queries, which has often been overlooked in previous reranking research. Moreover, multimodality fusion without an understanding of the query is risky, and may lead to incorrect judgment in reranking. Therefore, to obtain the best fusion weights for the query, in this paper, we leverage click-through data, which can be viewed as an "implicit" user feedback and an effective means of understanding the query. A novel reranking algorithm, called click-based relevance feedback, is proposed. This algorithm emphasizes the successful use of click-through data for identifying user search intention, while leveraging multiple kernel learning algorithm to adaptively learn the query-dependent fusion weights for multiple modalities. We conduct experiments on a real-world data set collected from a commercial search engine with click-through data. Encouraging experimental results demonstrate that our proposed reranking approach can significantly improve the NDCG@10 of the initial search results by 11.62%, and can outperform several existing approaches for most kinds of queries, such as tail, middle, and top queries.

Query Expansion and Query Fuzzy with Large-Scale Click-through Data for Microblog Retrieval

Clickthrough Refinement for Improved Graph Ranking

Compact Indexing and Judicious Searching for Billion-Scale Microblog Retrieval.

Machine Learning Based Query Expansion in Blog Retrieval

An Uncertainty-Aware Approach for Exploratory Microblog Retrieval

Probabilistic Query Expansion Using Query Logs

Feedback Model for Microblog Retrieval.

Query Expansion Based on Clustered Results

Query Expansion for Short Queries by Mining User Logs

Click Feedback-Aware Query Recommendation Using Adversarial Examples.

Optimizing web search using web click-through data.

Improving Multi-Faceted Book Search by Incorporating Sparse Latent Semantic Analysis of Click-Through Logs

Query Expansion by Mining User Logs

Image Search Reranking with Query-Dependent Click-Based Relevance Feedback.

Learning to Rank Microblog Posts for Real-Time Ad-Hoc Search.

Query Ambiguity Identification Based On User Behavior Information

Characterizing Expertise of Search Engine Users.

CrowdSeed: query processing on microblogs

Exploring relevance for clicks.

Modeling Perceived Relevance for Tail Queries without Click-Through Data

Exploring Tweets Normalization and Query Time Sensitivity for Twitter Search