Entropy based measure and its algorithms for scalable feature selection

Wei Zhang,Mingjun Xiao,Qingsheng Cai
2004-01-01
Abstract:Feature selection is an important issue in classification mining. An entropy based dependence measure-SCDEn, is educed from information theory. And an I/O linear feature selection algorithm - EnFSOS, using SCDEn measure, is constructed. The result features selected by EnFSOS are consistent with the target features in 10 open benchmarks, but more scalable than other algorithms.
What problem does this paper attempt to address?