ICRC_HITSZ at RITE: Leveraging Multiple Classifiers Voting for Textual Entailment Recognition.

Yaoyun Zhang,Jun Xu,Chenlong Liu,Xiaolong Wang,Ruifeng Xu,Qingcai Chen,Xuan Wang,Yongshuai Hou,Buzhou Tang
2011-01-01
Abstract:The NTCIR-9 RITE challenge is a generic benchmark task that evaluates systems' ability to automatically detect tex- tual entailment, paraphrase and contradiction. This paper describes the ICRC HITSZ system for RITE. We partici- pate in the binary-class (BC), the multi-class (MC) and the RITE4QA subtask. More specifically, we build textual en- tailment recognition models for the MC subtask. The pre- dicted multiple class labels are then mapped into Yes/No la- bels for the BC and RITE4QA subtasks. Different linguistic level features are extracted by using hybrid NLP resources and tools. Based on the hierarchical relations between the labels of the MC subtask, three different classification strate- gies are designed. Multiple machine learning methods are employed for each strategy. On the assumption that classi- fiers built from different classification strategies are comple- mentary to each other, so are the different machine learning methods. The final classifier is built with a cascade vot- ing. Evaluation results show that the voting strategies are effective, with the highest performance ranked at the fourth place in terms of accuracy, and at the second place in terms of participant groups in both tasks.
What problem does this paper attempt to address?