Mining Non-Redundant Diverse Patterns: an Information Theoretic Perspective

Chaofeng Sha,Jian Gong,Aoying Zhou
DOI: https://doi.org/10.1007/s11704-009-0072-9
2010-01-01
Frontiers of Computer Science in China
Abstract:The discovery of diversity patterns from binary data is an important data mining task. In this paper, we propose the problem of mining highly diverse patterns called non-redundant diversity patterns (NDPs). In this framework, entropy is adopted to measure the diversity of itemsets. In addition, an algorithm called NDP miner is proposed to exploit both monotone properties of entropy diversity measure and pruning power for the efficient discovery of non-redundant diversity patterns. Finally, our experimental results are given to show that the NDP miner can efficiently identify non-redundant diversity patterns.
What problem does this paper attempt to address?