A Novel Supervised Information Feature Compression Algorithm

Shi-fei Ding,Zhong-zhi Shi
DOI: https://doi.org/10.1007/11758501_103
2006-01-01
Abstract: In this paper, a novel supervised information feature compression algorithm is set up. Firstly, according to the information theories, we carried out analysis for the concept and its properties of the cross entropy, then put forward a kind of lately concept of symmetry cross entropy (SCE), and point out that the SCE is a kind of distance measure, which can be used to measure the difference of two random variables. Secondly, We make the SCE separability criterion of the classes for information feature compression, and design a novel algorithm for information feature compression. At last, the experimental results demonstrate that the algorithm here is valid and reliable, and provides a new research approach for feature compression, data mining and pattern recognition.
What problem does this paper attempt to address?