Random vector functional link network with subspace-based local connections

Yu-Lin He,Zhen-Hao Yuan,Joshua Zhexue Huang
DOI: https://doi.org/10.1007/s10489-022-03404-8
IF: 5.3
2022-04-30
Applied Intelligence
Abstract:A new random vector functional link (RVFL) network with subspace-based local connections (abbreviated as RVFL-SLC network) is proposed in this paper. The main innovation of RVFL-SLC network is that the local connections are utilized in the input-layer of RVFL network. To select appropriate local connections for RVFL-SLC network, a novel efficient decision entropy criterion is used to partition the original attribute space into disjoint attribute subspaces, where the different attribute subspaces correspond to the respective hidden-layer weights. The decision entropy of each attribute subspace is first defined based on the posterior probabilities of classes given the attribute subspace. Then, the attribute subspaces are iteratively updated to increase the validation accuracy of the RVFL-SLC network. In each iteration, the attribute subspace with the minimum decision entropy is selected as candidate for updating. The optimal attribute subspaces are finally obtained when the RVFL-SLC network reaches a stable validation accuracy. To evaluate the classification accuracy of RVFL-SLC, it was compared on 20 benchmark data sets with four other randomization-based networks, namely the regular RVFL network, regular extreme learning machine (ELM), ELM with local connections (ELM-LC), and the No-Prop network. Experimental results show that the proposed RVFL-SLC network not only obtains the highest testing accuracy compared to other randomization-based networks but also best prevents overfitting. This demonstrates the rationality and effectiveness of using the strategy of subspace-based local connections to improve the generalization capability of RVFL networks.
computer science, artificial intelligence
What problem does this paper attempt to address?