Abstract:Web search success evaluation is an effective way to evaluate the performance of search engines from the perspective of search experience. Many research efforts have been made to evaluate web search success via modeling user search behavior by analyzing search logs. Most of these studies consider the web search success evaluation as a binary classification problem, and use supervised learning approaches to evaluate whether a search experience is successful or not, which often require a large number of labeled data to learn accurately. Since unlabeled data of user search behaviors are easily obtainable in search logs, semi-supervised approaches have been exploited to improve the performance of web search success evaluation via combining labeled data and unlabeled data. However, the existing semi-supervised web search success evaluation approach would suffer from the model assumption violation, i.e., when the assumption of the model is not correct, training the web search success evaluation model with large amounts of unlabeled data would hurt the evaluation performance. In order to address this problem, a Multi-view Semi-Supervised web Search Success Evaluation (M4SE) approach is proposed, which exploits a multi-view mechanism during the semi-supervised learning process of web search success evaluation. M4SE considers the transitions between any two actions as the action view, and treats the dwell time between contiguous actions as the time view. M4SE uses the strategy of different parameter configurations on action and time views to generate diverse classifiers. Experiments on different search log datasets show that the proposed approach achieves better performance than the state-of-the-art semi-supervised approach for evaluating web search success.

Different Users, Different Opinions: Predicting Search Satisfaction With Mouse Movement Information

User Satisfaction Prediction with Mouse Movement Information in Heterogeneous Search Environment

Satisfaction Prediction of Web Search Users

Region-action LSTM for Mouse Interaction Sequence Based Search Satisfaction Evaluation

Does Vertical Bring more Satisfaction?: Predicting Search Satisfaction in a Heterogeneous Environment.

A Multi-View Semi-Supervised Approach for Task-Level Web Search Success Evaluation.

Investigating the Role of Eye Movements and Physiological Signals in Search Satisfaction Prediction Using Geometric Analysis

Search Task Success Evaluation by Exploiting Multi-View Active Semi-Supervised Learning.

Still Haven't Found What You're Looking For -- Detecting the Intent of Web Search Missions from User Interaction Features

Investigating Cognitive Effects in Session-level Search User Satisfaction

Meta-evaluation of Online and Offline Web Search Evaluation Metrics

Predicting Search User Examination with Visual Saliency

Enhancing click models with mouse movement information

"Satisfaction with Failure" or "Unsatisfied Success": Investigating the Relationship between Search Success and User Satisfaction.

Investigation Of User Search Behavior While Facing Heterogeneous Search Services

User Intent, Behaviour, and Perceived Satisfaction in Product Search.

Estimating Credibility of User Clicks with Mouse Movement and Eye-Tracking Information.

Towards Designing Better Session Search Evaluation Metrics

User Preference Prediction in Mobile Search.

Analysis into the Relationship Between Search Engine User Behavior and User Satisfaction Evaluation

The Influence of Image Search Intents on User Behavior and Satisfaction