An Information-Theory-based Feature Type Analysis for the Modelling of Statistical Parsing

ZF Sui,J Zhao,DK Wu
DOI: https://doi.org/10.3115/1075218.1075278
2000-01-01
Abstract:The paper proposes an information-theory-based method for feature types analysis in probabilistic evaluation modelling for statistical parsing. The basic idea is that we use entropy and conditional entropy to measure whether a feature type grasps some of the information for syntactic structure prediction. Our experiment quantitatively analyzes several feature types' power for syntactic structure prediction and draws a series of interesting conclusions.
What problem does this paper attempt to address?