Improving Encarta Search Engine Performance by Mining User Logs

CX Ling,JF Gao,HJ Zhang,WN Qian
DOI: https://doi.org/10.1142/s0218001402002179
IF: 1.261
2002-01-01
International Journal of Pattern Recognition and Artificial Intelligence
Abstract:We propose a data-mining approach that produces generalized query patterns (with generalized keywords) from the raw user logs of the Microsoft Encarta search engine (). Those query patterns can act as cache of the search engine, improving its performance. The cache of the generalized query patterns is more advantageous than the cache of the most frequent user queries since our patterns are generalized, covering more queries and future queries — even those not previously asked. Our method is unique since query patterns discovered reflect the actual dynamic usage and user feedbacks of the search engine, rather than the syntactic linkage structure of web pages (as Google does). Simulation shows that such generalized query patterns improve search engine's overall speed considerably. The generalized query patterns, when viewed with a graphical user interface, are also helpful to web editors, who can easily discover topics in which users are mostly interested.
What problem does this paper attempt to address?