Structure Preserving Projections Learning Via Low-Rank Embedding for Image Classification
Mingxiu Cai,Minghua Wan,Guowei Yang,Zhangjing Yang,Hao Zheng,Hai Tan,Mingwei Tang
DOI: https://doi.org/10.1016/j.ins.2023.119636
IF: 8.1
2023-01-01
Information Sciences
Abstract:Subspace mapping is a key step and an important tool for feature extraction and selection. Although subspace mapping methods are successful, there are still some common defects: 1) The final subspace does not possess global properties, only local properties; 2) most models fail to retain the low-rank structural information; and 3) the projection matrix contains considerable redundant and irrelevant information. Accordingly, we develop a novel method, i.e., structure preserving projections learning via low-rank embedding (SPPL-LRE), to address the above issues. We first extract the principal component information by seeking the projection directions of maximum variance, which makes the final subspace equipped with global properties. Then, SPPL-LRE regresses the principal component information to a classwise block-diagonal structure. In this way, the low-rank information and main energy of the data are held in the subspace so that the obtained projection can extract more salient and informative features. Meanwhile, introducing low-rank information can also enhance the robustness of the model. Moreover, a strong L2 norm constraint is imposed on the projection to avoid model overfitting and exclude the interference of redundant information, which can enhance the interpretability of the model. Finally, we introduce the graph smoothness of the representation matrix to better preserve the manifold geometry of the original data. Extensive experiments indicate that our method is more robust and effective than other state-of-the-art methods.