Self-paced Principal Component Analysis

Zhao Kang,Hongfei Liu,Jiangxin Li,Xiaofeng Zhu,Ling Tian
DOI: https://doi.org/10.1016/j.patcog.2023.109692
2021-01-01
Abstract:Principal Component Analysis (PCA) has been widely used for dimensionality reduction and feature ex-traction. Robust PCA (RPCA), under different robust distance metrics, such as & POUND;1-norm and & POUND;2 ,p-norm, can deal with noise or outliers to some extent. However, real-world data may display structures that can not be fully captured by these simple functions. In addition, existing methods treat complex and simple sam -ples equally. By contrast, a learning pattern typically adopted by human beings is to learn from simple to complex and less to more. Based on this principle, we propose a novel method called Self-paced PCA (SPCA) to further reduce the effect of noise and outliers. Notably, the complexity of each sample is cal-culated at the beginning of each iteration in order to integrate samples from simple to more complex into training. Based on an alternating optimization, SPCA finds an optimal projection matrix and filters out outliers iteratively. Theoretical analysis is presented to show the rationality of SPCA. Extensive ex-periments on popular data sets demonstrate that the proposed method can improve the state-of-the-art results considerably. & COPY; 2023 Elsevier Ltd. All rights reserved.
What problem does this paper attempt to address?