Effective and Efficient Multi-label Feature Selection Approaches Via Modifying Hilbert-Schmidt Independence Criterion

Jianhua Xu
DOI: https://doi.org/10.1007/978-3-319-46675-0_42
2016-01-01
Abstract:Hilbert-Schmidt independence criterion (HSIC) is a non-parametric dependence measure to depict all modes of dependencies between two sets of variables via matrix trace. When this criterion with linear feature and label kernels is directly applied to multi-label feature selection, an efficient feature ranking is achieved using diagonal elements, which considers only feature-label relevance. But non-diagonal elements essentially characterize feature-feature conditional redundancy. In this paper, two novel criteria are defined by all matrix elements. For a candidate feature, we both maximize its relevance and minimize its average or maximal redundancy. Then an efficient hybrid strategy combining simple feature ranking and sequential forward selection is implemented, where the former sorts all features in descending order using their relevance and the latter finds out the top discriminative features with relevance maximization and redundancy minimization. Experiments on four data sets illustrate that our proposed methods are effective and efficient, compared with several existing techniques, according to classification performance and computational efficiency.
What problem does this paper attempt to address?