Abstract:Nowadays, web search becomes more and more popular all over the world. Many researchers and developers have done lots of studies on behaviors of search users. In practice, the full understanding of these behaviors can not only help to evaluate the usefulness of newly-developed ranking algorithms and other changes of search engine, but also to guide the growth direction of search engine. As far as we know, most of past work are mainly focused on single search evaluation, which do promote the rapid development of search engine in early stage. However,these page-level behaviors are so limited that can no longer give explicit feedbacks on minor changes of the search engine. We think that it will be more accurate and sensitive when more information on search session are provided. In this paper, a session level evaluation method is proposed. The session-level features are retrieved and carefully analyzed. Some linear and non-linear features which can reflect the final degree of satisfaction are chosen and adopted in evaluation models. A two-layer hybrid evaluation model with different granularity, which can achieve good precision and recall, is designed and trained. Lots of real experiments are evaluated by the model, the result shows it achieved a higher accuracy performance than traditional page-level evaluation metrics. Furthermore, for practical application, it is important to interpret the reason of each session's satisfaction judgement. In all, a session-level evaluation model with improved performance and well capability on interpretation is proposed and applied in real practice in search engine companies.

Performance Evaluation of Online Sponsored Search Based on User Log Analysis

Effectiveness of online sponsored search based on user log analysis

The Effectiveness of Online Sponsored Search from Search Users ’ Perspective

Dynamic Analysis of Chinese Search Engine User Behavior

Search Engine User Behavior Analysis Based on Log Mining

Automatic Search Engine Performance Evaluation Based on User Behavior Analysis

Automatic Search Engine Evaluation Based On User Behavior Analysis

Implementing Sponsored Search in Web Search Engines: Computational Evaluation of Alternative Mechanisms.

How Do Sponsored Search Results Affect User Behavior In Web Search?

Automatic Search Engine Performance Evaluation with Click-Through Data Analysis

A Study of User Image Search Behavior Based on Log Analysis.

Ads-clicking Intent Analysis of Search Engine Queries

How do users grow up along with search engines?: a study of long-term users' behavior.

Advertiser-centric Approach to Understand User Click Behavior in Sponsored Search

Still Haven't Found What You're Looking For -- Detecting the Intent of Web Search Missions from User Interaction Features

Internet-based Marketing Service Innovation and Its Value——Evidence from Sponsored Search Advertising

Web Search Engine: Characteristics of User Behaviors and Their Implication

Behavior-based evaluation of session satisfaction

Analysis into the Relationship Between Search Engine User Behavior and User Satisfaction Evaluation

Log mining to improve the performance of site search

A Study on Potential Head Advertisers in Sponsored Search.