Improving Session Search Performance with a Multi-MDP Model.

Jia Chen,Yiqun Liu,Cheng Luo,Jiaxin Mao,Min Zhang,Shaoping Ma
DOI: https://doi.org/10.1007/978-3-030-03520-4_5
2018-01-01
Abstract:To fulfill some sophisticated information needs in Web search, users may submit multiple queries in a search session. Session search aims to provide an optimized document rank by utilizing query log as well as user interaction behaviors within a search session. Although a number of solutions were proposed to solve the session search problem, most of these efforts simply assume that users’ search intents stay unchanged during the search process. However, most complicated search tasks involve exploratory processes where users’ intents evolve while interacting with search results. The evolving process leaves the static search intent assumption unreasonable and hurts the performance of document rank. To shed light on this research question, we propose a system with multiple agents which adjusts its framework by a self-adaption mechanism. In the framework, each agent models the document ranking as a Markov Decision Process (MDP) and updates its parameters by Reinforcement Learning algorithms. Experimental results on TREC Session Track datasets (2013 u0026 2014) show the effectiveness of the proposed framework.
What problem does this paper attempt to address?