Overview of the NTCIR-11 IMine Task.
Yiqun Liu,Ruihua Song,Min Zhang,Zhicheng Dou,Takehiro Yamamoto,Makoto P. Kato,Hiroaki Ohshima,Ke Zhou
2014-01-01
Abstract:In this paper, we provide an overview of the NTCIR IMine task, which is a core task of NTCIR-11 and also a succeeding work of INTENT@NTCIR-9 and INTENT2@NTCIR-10 tasks. IMine is composed of a subtopic mining (SM) task, a document ranking (DR) task and a TaskMine (TM) pilot task. 21 groups from Canada, China, Germany, France, Japan, Korea, Spain, UK and United States registered to the task, which makes it one of the largest tasks in NTCIR-11. Finally, we receive 45 runs from 10 teams to the SM task, 25 runs from 6 groups to the DR task and 3 runs from 2 groups to the TM task. We describe the task details, annotation of results, evaluation strategies and then the official evaluation results for each subtask.