Robust Active Representation Via ℓ2,p-Norm Constraints
Jiaoyan Zhao,Shuangyan Yi,Yongsheng Liang,Wei Liu,Xiaofeng Cao
DOI: https://doi.org/10.1016/j.knosys.2021.107639
IF: 8.139
2021-01-01
Knowledge-Based Systems
Abstract:Active learning maximizes the performance of the current learning model by soliciting benefits from unlabeled data. In its early stage with insufficient labels, finding representations that maintain a consistent hypothesis with the entire unlabeled pool is an intelligent paradigm. From a matrix perspective, this paradigm can be transformed into a sparse representation of the input matrix by the ℓ 2 , 1-norm constraint. However, the ℓ 2 , 1-norm constraint is used in the loss function, which may lead to the mean accumulation problem, resulting in sub-optimal mean-centering and low robustness to outliers. In this paper, to solve the aforementioned problems, we generalize the ℓ 2 , 1-norm into the ℓ 2 , p-norm constraint, where 0 < p ≤ 1. Specifically, when p = 1, the ℓ 2 , 1 constraint derives the optimal mean-centering, avoiding biased feature transformations, and when 0 < p < 1, ℓ 2 , p regulates the sparsity of the loss function and regularization terms in the matrix representation, yielding robust active representations. Experiment results on benchmark databases demonstrate that our method outperforms other state-of-the-art active learning methods, particularly for outlier perturbations.