Double-Structured Sparsity Guided Flexible Embedding Learning for Unsupervised Feature Selection
Yu Guo,Yuan Sun,Zheng Wang,Feiping Nie,Fei Wang
DOI: https://doi.org/10.1109/tnnls.2023.3267184
IF: 14.255
2023-01-01
IEEE Transactions on Neural Networks and Learning Systems
Abstract:In this article, we propose a novel unsupervised feature selection model combined with clustering, named double-structured sparsity guided flexible embedding learning (DSFEL) for unsupervised feature selection. DSFEL includes a module for learning a block-diagonal structural sparse graph that represents the clustering structure and another module for learning a completely row-sparse projection matrix using the l<sub>2,0</sub> -norm constraint to select distinctive features. Compared with the commonly used l<sub>2,1</sub> -norm regularization term, the l<sub>2,0</sub> -norm constraint can avoid the drawbacks of sparsity limitation and parameter tuning. The optimization of the l<sub>2,0</sub> -norm constraint problem, which is a nonconvex and nonsmooth problem, is a formidable challenge, and previous optimization algorithms have only been able to provide approximate solutions. In order to address this issue, this article proposes an efficient optimization strategy that yields a closed-form solution. Eventually, through comprehensive experimentation on nine real-world datasets, it is demonstrated that the proposed method outperforms existing state-of-the-art unsupervised feature selection methods.
computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture