Abstract:We study the problem of deep recall model in industrial web search, which is, given a user query, retrieve hundreds of most relevance documents from billions of candidates. The common framework is to train two encoding models based on neural embedding which learn the distributed representations of queries and documents separately and match them in the latent semantic space. However, all the exiting encoding models only leverage the information of the document itself, which is often not sufficient in practice when matching with query terms, especially for the hard tail queries. In this work we aim to leverage the additional information for each document from its co-click neighbour to help document retrieval. The challenges include how to effectively extract information and eliminate noise when involving co-click information in deep model while meet the demands of billion-scale data size for real time online inference. To handle the noise in co-click relations, we firstly propose a web-scale Multi-Intention Co-click document Graph(MICG) which builds the co-click connections between documents on click intention level but not on document level. Then we present an encoding framework MIRA based on Bert and graph attention networks which leverages a two-factor attention mechanism to aggregate neighbours. To meet the online latency requirements, we only involve neighbour information in document side, which can save the time-consuming query neighbor search in real time serving. We conduct extensive offline experiments on both public dataset and private web-scale dataset from two major commercial search engines demonstrating the effectiveness and scalability of the proposed method compared with several baselines. And a further case study reveals that co-click relations mainly help improve web search quality from two aspects: key concept enhancing and query term complementary.

Improving Multi-Faceted Book Search by Incorporating Sparse Latent Semantic Analysis of Click-Through Logs

Query Subtopic Mining Via Subtractive Initialization of Non-negative Sparse Latent Semantic Analysis

Still Haven't Found What You're Looking For -- Detecting the Intent of Web Search Missions from User Interaction Features

ILCR: Item-based Latent Factors for Sparse Collaborative Retrieval

Clickage: towards bridging semantic and intent gaps via mining click logs of search engines.

LADER: Log-Augmented DEnse Retrieval for Biomedical Literature Search

Mining Latent Attributes from Click-through Logs for Image Recognition

GRAFS: Graphical Faceted Search System to Support Conceptual Understanding in Exploratory Search

Optimizing web search using web click-through data.

Learning to Ask Critical Questions for Assisting Product Search

Leverage Implicit Feedback for Context-aware Product Search

Time-dependent Semantic Similarity Measure of Queries Using Historical Click-Through Data.

Personalized Entity Search by Sparse and Scrutable User Profiles

Enhanced Facet Generation with LLM Editing

Latent Semantic Indexing in Peer-to-Peer Networks.

A Multi-level Interactive Lifelog Search Engine with User Feedback.

Hybrid Semantic Search: Unveiling User Intent Beyond Keywords

Modeling Attractiveness and Multiple Clicks in Sponsored Search Results

User Behavior Modeling for Better Web Search Ranking

Intent-Oriented Dynamic Interest Modeling for Personalized Web Search

MIRA: Leveraging Multi-Intention Co-click Information in Web-scale Document Retrieval using Deep Neural Networks