Abstract:Personalized search is a promising way to improve search qualities by taking user interests into consideration. Recently, machine learning and deep learning techniques have been successfully applied to search result personalization. Most existing models simply regard the personal search history as a static set of user behaviors and learn fixed ranking strategies based on all the recorded data. Though improvements have been achieved, the essence that the search process is a sequence of interactions between the search engine and user is ignored. The user’s interests may dynamically change during the search process, therefore, it would be more helpful if a personalized search model could track the whole interaction process and adjust its ranking strategy continuously. In this article, we adapt reinforcement learning to personalized search and propose a framework, referred to as RLPS. It utilizes a Markov Decision Process ( MDP ) to track sequential interactions between the user and search engine, and continuously update the underlying personalized ranking model with the user’s real-time feedback to learn the user’s dynamic interests. Within this framework, we implement two models: the listwise RLPS-L and the hierarchical RLPS-H. RLPS-L interacts with users and trains the ranking model with document lists, while RLPS-H improves model training by designing a layered structure and introducing document pairs. In addition, we also design a feedback-aware personalized ranking component to capture the user’s feedback, which impacts the user interest profile for the next query. Significant improvements over existing personalized search models are observed in the experiments on the public AOL search log and a commercial log.

Personalized Domain-Specific Search Engine

Personalized web search for improving retrieval effectiveness

PERSONALIZED SEARCH RESEARCH BASED ON LOCAL ADD-ON

Context-Based Adaptive Personalized Web Search for Improving Information Retrieval Effectiveness

Research on the Personalized Information Retrieval in Intelligent Search Engine

Personalizing Search Engine Design on User's Interest

A Hybrid Approach to Personalized Web Search

The Personalized Information Retrieval on the Basis of User-mode

An Iterative Implicit Feedback Approach To Personalized Search

Personalized Diversity Search Based on User’s Social Relationships

Cluster-based Personal Search Engine

Enabling Personalized Search over Encrypted Outsourced Data with Efficiency Improvement

Personalized Search: an Interactive and Iterative Approach.

Personalized Searching for Web Service Using User Interests

RLPS: A Reinforcement Learning–Based Framework for Personalized Search

Personalized Concept-Based Clustering of Search Engine Queries

The Design & Implement of Personalized P2P Content Search System

Design and Implementation of Domain-Oriented Intelligent Searchengine

Supporting Privacy Protection in Personalized Web Search

How to personalize and whether to personalize? Candidate documents decide

A Framework for Personalized Information Retrieval Model