Research on Evaluation of Personalized Information Retrieval Based on Manual Annotation

张宇,范基礼,郑伟,邹博伟,刘挺
DOI: https://doi.org/10.3969/j.issn.1003-0077.2009.02.009
2009-01-01
Abstract:Personalized information retrieval can grasp the users' retrieval intention and find personalized results.A manual annotation system is designed in this paper to generate the corpus for evaluating personalized IR system.Then the User-centered manual annotation strategy is proposed for personalized IR evaluation.The evaluation system adopts the evaluation scheme provided by NIST performs an automatic evaluation according to the manually annotated results,and generates the quantified and straight-forward measurement results.
What problem does this paper attempt to address?