Abstract:Entity recommendation, providing users with an improved search experience by proactively recommending related entities to a given query, has become an indispensable feature of today’s Web search engine. Existing studies typically only consider the query issued at the current timestep while ignoring the in-session user search behavior (short-term search history) or historical user search behavior across all sessions (long-term search history) when generating entity recommendations. As a consequence, they may fail to recommend entities of interest relevant to a user’s actual information need. In this work, we believe that both short-term and long-term search history convey valuable evidence that could help understand the user’s search intent behind a query, and take both of them into consideration for entity recommendation. Furthermore, there has been little work on exploring whether the use of other companion tasks in Web search such as document ranking as auxiliary tasks could improve the performance of entity recommendation. To this end, we propose a multi-task learning framework with deep neural networks (DNNs) to jointly learn and optimize two companion tasks in Web search engines: entity recommendation and document ranking, which can be easily trained in an end-to-end manner. Specifically, we regard document ranking as an auxiliary task to improve the main task of entity recommendation, where the representations of queries, sessions, and users are shared across all tasks and optimized by the multi-task objective during training. We evaluate our approach using large-scale, real-world search logs of a widely-used commercial Web search engine. We also performed extensive ablation experiments over a number of facets of the proposed multi-task DNN model to figure out their relative importance. The experimental results show that both short-term and long-term search history can bring significant improvements in recommendation effectiveness, and the combination of both outperforms using either of them individually. In addition, the experiments show that the performance of both entity recommendation and document ranking can be significantly improved, which demonstrates the effectiveness of using multi-task learning to jointly optimize the two companion tasks in Web search.

PatternRank+NN

PatternRank plus NN: A Ranking Framework Bringing User Behaviors into Entity Set Expansion from Web Search Queries

Learning to rank related entities in Web search

Ranking related entities for web search queries.

NERank: Bringing Order to Named Entities from Texts.

NERank+: a Graph-Based Approach for Entity Ranking in Document Collections.

Learning to Explain Entity Relationships by Pairwise Ranking with Convolutional Neural Networks.

Multi-Task Learning for Entity Recommendation and Document Ranking in Web Search

A Context-Aware Entity Ranking Method for Web-Based Data Imputation

GNEM: A Generic One-to-Set Neural Entity Matching Framework

X-Rank: Explainable Ranking in Complex Multi-Layered Networks.

A Probability Model for Related Entity Retrieval Using Relation Pattern

Heuristic Rank Selection with Progressively Searching Tensor Ring Network

Entity Set Search of Scientific Literature: An Unsupervised Ranking Approach

A Relation Pattern-Driven Probability Model for Related Entity Retrieval

NERank: Ranking Named Entities in Document Collections.

Entity Set Expansion Via Knowledge Graphs

Bootstrapping Large-scale Named Entities Using URL-Text Hybrid Patterns.

Graph Pattern Entity Ranking Model for Knowledge Graph Completion

$k$NN-NER: Named Entity Recognition with Nearest Neighbor Search

SERank: Optimize Sequencewise Learning to Rank Using Squeeze-and-Excitation Network