Research on Standard of Evaluation of Multi-Document Summarization

WEI Ji-zeng,SUN Ji-zhou,QIN Bing
DOI: https://doi.org/10.3321/j.issn:1002-8331.2007.02.053
2007-01-01
Computer Engineering and Applications Journal
Abstract:Multi-document automatic summarization is an important branch of natural language understanding.But the methods of evaluation of the Multi-document automatic summarization also have many problems,which are single and lack of uniform standard.The investigative point in this text is to attempt to give a standard aiming at the covered rate of information of Multi-document automatic summarization.This standard will use a few of parameters:improved BLEU parameter(recall),covered rate of effective phrase with original documents,high frequency phrase covered rate.The experiments have indicated this standard can reflect the covered rate of information of summarization system good or bad,and whether it is near to artificial evaluation results.
What problem does this paper attempt to address?