Abstract:We study the problem of deep recall model in industrial web search, which is, given a user query, retrieve hundreds of most relevance documents from billions of candidates. The common framework is to train two encoding models based on neural embedding which learn the distributed representations of queries and documents separately and match them in the latent semantic space. However, all the exiting encoding models only leverage the information of the document itself, which is often not sufficient in practice when matching with query terms, especially for the hard tail queries. In this work we aim to leverage the additional information for each document from its co-click neighbour to help document retrieval. The challenges include how to effectively extract information and eliminate noise when involving co-click information in deep model while meet the demands of billion-scale data size for real time online inference. To handle the noise in co-click relations, we firstly propose a web-scale Multi-Intention Co-click document Graph(MICG) which builds the co-click connections between documents on click intention level but not on document level. Then we present an encoding framework MIRA based on Bert and graph attention networks which leverages a two-factor attention mechanism to aggregate neighbours. To meet the online latency requirements, we only involve neighbour information in document side, which can save the time-consuming query neighbor search in real time serving. We conduct extensive offline experiments on both public dataset and private web-scale dataset from two major commercial search engines demonstrating the effectiveness and scalability of the proposed method compared with several baselines. And a further case study reveals that co-click relations mainly help improve web search quality from two aspects: key concept enhancing and query term complementary.

A Search Engine Click Model Based on Deep Neural Network

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

User Behavior Modeling for Better Web Search Ranking

Clickthrough Refinement for Improved Graph Ranking

A Novel Click-Through Rate Prediction Model Based on Deep Feature Fusion Network

A Context-Aware Click Model for Web Search.

Deeply Supervised Semantic Model for Click-Through Rate Prediction in Sponsored Search

Modeling Attractiveness and Multiple Clicks in Sponsored Search Results

Enhancing click models with mouse movement information

MIRA: Leveraging Multi-Intention Co-click Information in Web-scale Document Retrieval using Deep Neural Networks

FE-TCM: Filter-Enhanced Transformer Click Model for Web Search

An adaptive hybrid XdeepFM based deep Interest network model for click-through rate prediction system

Deep Learning of Human Information Foraging Behavior with a Search Engine

Why Don't You Click: Understanding Non-Click Results inWeb Search with Brain Signals

Explore click models for search ranking.

Prediction of Click-through Rate of Marketing Advertisements Using Deep Learning

Click chain model in web search.

Learning Click-Based Deep Structure-Preserving Embeddings with Visual Attention.

Self-Attention Mechanism Enhanced User Interests Modeling for Personalized Recommendation Services in Cyber-Physical-Social Systems.

Clickage: towards bridging semantic and intent gaps via mining click logs of search engines.

A Social Search Model for Large Scale Social Networks