Abstract:User information needs vary significantly across different tasks, and therefore their queries will also differ considerably in their expressiveness and semantics. Many studies have been proposed to model such query diversity by obtaining query types and building query-dependent ranking models. These studies typically require either a labeled query dataset or clicks from multiple users aggregated over the same document. These techniques, however, are not applicable when manual query labeling is not viable, and aggregated clicks are unavailable due to the private nature of the document collection, e.g., in email search scenarios. In this paper, we study how to obtain query type in an unsupervised fashion and how to incorporate this information into query-dependent ranking models. We first develop a hierarchical clustering algorithm based on truncated SVD and varimax rotation to obtain coarse-to-fine query types. Then, we study three query-dependent ranking models, including two neural models that leverage query type information as additional features, and one novel multi-task neural model that views query type as the label for the auxiliary query cluster prediction task. This multi-task model is trained to simultaneously rank documents and predict query types. Our experiments on tens of millions of real-world email search queries demonstrate that the proposed multi-task model can significantly outperform the baseline neural ranking models, which either do not incorporate query type information or just simply feed query type as an additional feature.

Multi-view Embedding-based Synonyms for Email Search

Going Beyond Multi-Task Dense Prediction with Synergy Embedding Models

Domain Lexicon-Based Query Expansion for Patent Retrieval

Exploiting Semantic Knowledge Base for Patent Retrieval

Search Task Success Evaluation by Exploiting Multi-View Active Semi-Supervised Learning.

Separate and Attend in Personal Email Search

Multi-Task Learning for Email Search Ranking with Auxiliary Query Clustering

Practice in Synonym Extraction at Large Scale

SynSetExpan: An Iterative Framework for Joint Entity Set Expansion and Synonym Discovery

A bilateral context and filtering strategy-based approach to Chinese entity synonym set expansion

Learning Multi-Stage Multi-Grained Semantic Embeddings for E-Commerce Search

Replicating Relevance-Ranked Synonym Discovery in a New Language and Domain

Retrieve Synonymous keywords for Frequent Queries in Sponsored Search in a Data Augmentation Way

Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context

Not All Synonyms Are Created Equal: Incorporating Similarity of Synonyms to Enhance Word Embeddings

Medical Synonym Extraction with Concept Space Models

SynET: Synonym Expansion Using Transitivity

Pre-Trained Multi-View Word Embedding Using Two-Side Neural Network

Multi-Distribution Characteristics Based Chinese Entity Synonym Extraction from The Web

Term Set Expansion based on Multi-Context Term Embeddings: an End-to-end Workflow

Entity Synonym Discovery Via Multiple Attentions