Abstract:Nowadays, web search becomes more and more popular all over the world. Many researchers and developers have done lots of studies on behaviors of search users. In practice, the full understanding of these behaviors can not only help to evaluate the usefulness of newly-developed ranking algorithms and other changes of search engine, but also to guide the growth direction of search engine. As far as we know, most of past work are mainly focused on single search evaluation, which do promote the rapid development of search engine in early stage. However,these page-level behaviors are so limited that can no longer give explicit feedbacks on minor changes of the search engine. We think that it will be more accurate and sensitive when more information on search session are provided. In this paper, a session level evaluation method is proposed. The session-level features are retrieved and carefully analyzed. Some linear and non-linear features which can reflect the final degree of satisfaction are chosen and adopted in evaluation models. A two-layer hybrid evaluation model with different granularity, which can achieve good precision and recall, is designed and trained. Lots of real experiments are evaluated by the model, the result shows it achieved a higher accuracy performance than traditional page-level evaluation metrics. Furthermore, for practical application, it is important to interpret the reason of each session's satisfaction judgement. In all, a session-level evaluation model with improved performance and well capability on interpretation is proposed and applied in real practice in search engine companies.

Research on User Behavior Based on Session Analysis

Investigating Characteristics Of Non-Click Behavior Using Query Logs

Search Engine User Behavior Analysis Based on Log Mining

A Study of User Image Search Behavior Based on Log Analysis.

Exploration of the Behavioral Model of User-Web Interaction

Dynamic Analysis of Chinese Search Engine User Behavior

Investigating Query Reformulation Behavior Of Search Users

Search Behavior Study Based on the Mobile SearchLog

Searching, browsing, and clicking in a search session: changes in user behavior by task and over time

An Analysis of the Search Engine User Behaviors Based on Hadoop

An Investigation of Cybercrime-Related Online Search Behavior vs General Search Behavior

Behavior-based evaluation of session satisfaction

User Behaviors Lend a Helping Hand: Learning Paraphrase Query Patterns from Search Log Sessions.

How do users grow up along with search engines?: a study of long-term users' behavior.

Sogou Query Log Analysis: A Case Study for Collaborative Recommendation or Personalized IR

Joint Analysis Method of Multiple Search Behaviors

Abnormal Click Analysis in Web User Access Logs

An exploration of risk information search via a search engine: Queries and clicks in healthcare and information security

Revealing Secrets in SPARQL Session Level

Geometric session detection method for sogou log

A Term-Based Methodology for Query Reformulation Understanding