Abstract:Information Retrieval (IR) concerns about the structure, analysis, organization, storage, and retrieval of information. Among different retrieval models proposed in the past decades, generative retrieval models, especially those under the statistical probabilistic framework, are one of the most popular techniques that have been widely applied to Information Retrieval problems. While they are famous for their well-grounded theory and good empirical performance in text retrieval, their applications in IR are often limited by their complexity and low extendability in the modeling of high-dimensional information. Recently, advances in deep learning techniques provide new opportunities for representation learning and generative models for information retrieval. In contrast to statistical models, neural models have much more flexibility because they model information and data correlation in latent spaces without explicitly relying on any prior knowledge. Previous studies on pattern recognition and natural language processing have shown that semantically meaningful representations of text, images, and many types of information can be acquired with neural models through supervised or unsupervised training. Nonetheless, the effectiveness of neural models for information retrieval is mostly unexplored. In this thesis, we study how to develop new generative models and representation learning frameworks with neural models for information retrieval. Specifically, our contributions include three main components: (1) Theoretical Analysis: We present the first theoretical analysis and adaptation of existing neural embedding models for ad-hoc retrieval tasks; (2) Design Practice: Based on our experience and knowledge, we show how to design an embedding-based neural generative model for practical information retrieval tasks such as personalized product search; And (3) Generic Framework: We further generalize our proposed neural generative framework for complicated heterogeneous information retrieval scenarios that concern text, images, knowledge entities, and their relationships. Empirical results show that the proposed neural generative framework can effectively learn information representations and construct retrieval models that outperform the state-of-the-art systems in a variety of IR tasks.

Information Retrieval: 25th China Conference, CCIR 2019, Fuzhou, China, September 20–22, 2019, Proceedings

Mining User Profiles from Query Log

Query Subtopic Mining Via Subtractive Initialization of Non-negative Sparse Latent Semantic Analysis

Neural Demographic Prediction Using Search Query.

A LDA Topic Model Based Collection Selection Method for Distributed Information Retrieval

Who are Like-minded: Mining User Interest Similarity in Online Social Networks

Dynamic Semantic Clustering Approach For Web User Interest

Deep Learning of Human Information Foraging Behavior with a Search Engine

Personalizing Search Results Using Hierarchical RNN with Query-aware Attention

Mining Search Subtopics from Query Logs.

An information retrieval system based on a user profile

Neural Generative Models and Representation Learning for Information Retrieval.

A study of user profile representation for personalized cross-language information retrieval

You Are What You Search: Attribute Inference Attacks Through Web Search Queries

On Mining Latent Topics from Healthcare Chat Logs.

Mining User Privacy Concern Topics from App Reviews

Personalized web search for improving retrieval effectiveness

Generating Relevant and Informative Questions for Open-domain Conversations

Identifying User Profile by Incorporating Self-Attention Mechanism based on CSDN Data Set

Multiple User Context Inference by Fusing Data Sources

Social User Profiling: A Social-Aware Topic Modeling Perspective