Abstract:A number of search user behavior studies show that queries with unclear intents are commonly submitted to search engines. Result diversification is usually adopted to deal with those queries, in which search engine tries to trade-off some relevancy for some diversity to improve user experience. In this work, we aim to improve the performance of search results diversification by generating an intent subtopics list with fusion of multiple resources. We based our approach by thinking that to collect a large panel of intent subtopics, we should consider as well a wide range of resources from which to extract. The resources adopted cover a large panel of sources, such as external resources (Wikipedia, Google Keywords Generator, Google Insights, Search Engines query suggestion and completion), anchor texts, page snippets and more. We selected resources to cover both information seeker (What a user is searching for) and information provider (The websites) aspects. We also proposed an efficient Bayesian optimization approach to maximize resources selection performances, and a new technique to cluster subtopics based on the top results snippet information and Jaccard Similarity coefficient. Experiments based on TREC 2012 web track and NTCIR-10 intent task show that our framework can greatly improve diversity while keeping a good precision. The system developed with the proposed techniques also achieved the best English subtopic mining performance in NTCIR-10 intent task.

Web Mining Based On Vips In Intention-Based Information Retrieval

Interest Mining in Virtual Learning Environments

DEEP WEB DATA SOURCES CLASSIFICATION BASED ON TEXT VSM OF QUERY INTERFACE

Improving Pseudo-Relevance Feedback in Web Information Retrieval Using Web Page Segmentation.

Dynamic Semantic Clustering Approach For Web User Interest

Web Pages Clustering and Concepts Mining: an Approach Towards Intelligent Information Retrieval

User Interest Mining Based on the Bayesian Probability

VIPS: a Vision-based Page Segmentation Algorithm

Mining Search Subtopics from Query Logs.

Personal Interest Mining Algorithm Based on SSPISIA Data Collection

User Intention Modeling in Web Applications Using Data Mining

Dynamic mining for web navigation patterns based on markov model

Improve Web Search Diversification with Intent Subtopic Mining

Mining Subtopics from Text Fragments for a Web Query

Practice of Web Mining Based on Nature Language Understanding

Research on the Design and Implementation of Web Mining System

An Approach Web Mining Based Personalized Web

Visual query suggestion: Towards capturing user intent in internet image search

Research on the Personalized Information Retrieval in Intelligent Search Engine

Enhancing Web Search with Queries of Equivalent Intents

A language independent web data extraction using vision based page segmentation algorithm