Multilayer discriminative extreme learning machine for classification
Jie Lai,Xiaodan Wang,Qian Xiang,Yafei Song,Wen Quan
DOI: https://doi.org/10.1007/s13042-022-01749-7
2022-12-31
International Journal of Machine Learning and Cybernetics
Abstract:The representation learning is the key to deep learning. As a special deep learning algorithm, the generalization performance of the multilayer extreme learning machine (ML-ELM) is influenced by the feature extraction capability of the extreme learning machine autoencoder (ELM-AE). But the ELM-AE does not consider class labels, and it is difficult for the ELM-AE to build the discriminative feature space in the classification tasks. Thus, to improve the class separability of abstract feature, the discriminant regularization is introduced into the ELM-AE and a new regularized ELM-AE called discriminative extreme learning machine autoencoder (DELM-AE) is proposed. And by stacking the ELM-AE for feature extraction and adopting the ELM for classifying, the multilayer discriminative extreme learning machine (ML-DELM) is proposed for classification tasks. The DELM-AE adds the discriminant regularization term to the loss function to reduce the distance between samples and their class centers in feature space. Compared with the ELM-AE and ML-ELM, the DELM-AE and ML-DELM indirectly utilizes the category information contained in the discriminant regularization term to guide the feature extraction. Empirical evaluations and experiments on various benchmark datasets show that feature representation learned by the DELM-AE is discriminative and sparse, and the generalization performance and structural sparsity of ML-DELM are comparable with the other state-of-the-art ML-ELM algorithms.
computer science, artificial intelligence