Abstract:Personalized search is a promising way to improve search qualities by taking user interests into consideration. Recently, machine learning and deep learning techniques have been successfully applied to search result personalization. Most existing models simply regard the personal search history as a static set of user behaviors and learn fixed ranking strategies based on all the recorded data. Though improvements have been achieved, the essence that the search process is a sequence of interactions between the search engine and user is ignored. The user’s interests may dynamically change during the search process, therefore, it would be more helpful if a personalized search model could track the whole interaction process and adjust its ranking strategy continuously. In this article, we adapt reinforcement learning to personalized search and propose a framework, referred to as RLPS. It utilizes a Markov Decision Process ( MDP ) to track sequential interactions between the user and search engine, and continuously update the underlying personalized ranking model with the user’s real-time feedback to learn the user’s dynamic interests. Within this framework, we implement two models: the listwise RLPS-L and the hierarchical RLPS-H. RLPS-L interacts with users and trains the ranking model with document lists, while RLPS-H improves model training by designing a layered structure and introducing document pairs. In addition, we also design a feedback-aware personalized ranking component to capture the user’s feedback, which impacts the user interest profile for the next query. Significant improvements over existing personalized search models are observed in the experiments on the public AOL search log and a commercial log.

PDABP: A framework of policy-driven agent-based personalized information retrieval system

A Survey of Personalised Image Retrieval and Recommendation.

Design and Implementation of a Personalized Information Retrieval Agent

An Iterative Implicit Feedback Approach To Personalized Search

PD-Agent: A Flexible Agent BDI Model for Autonomic Computing

Toward Ontology-based Personalized Information Service System Framework

RLPS: A Reinforcement Learning–Based Framework for Personalized Search

Design and Implementation of the Personalized Information Retrieval Service Interface

RECENT ADVANCES IN PERSONAL RECOMMENDER SYSTEMS

A Policy-Driven Autonomous System to Implement Web Services.

Peer-to-peer Based Personalized Web Information Retrieval

Personalization in text information retrieval: A survey

Implicit Acquisition of Context for Personalization of Information Retrieval Systems

Dynamic Self-Organizing System Supported by PDC-Agent

Personal Informational Recommendation Service: Based on Multi-Agent Hybrid Intelligence

A Personalized Agents Platform Design and Implementation for Personalized Education

Research and implementation of a personalized recommendation system

An Agent-based Framework for Intelligent and Dynamic Business Information Retrieval

APEX: A Personalization Framework to Improve Quality of Experience for DVD-like Functions in P2P VoD Applications

A Personalized Dense Retrieval Framework for Unified Information Access

Information Retrieval Strategies of Personal Digital Libraries in the Networked Environment