Structure and weights search for classification with feature selection based on brain storm optimization algorithm

Yu Xue,Yan Zhao
DOI: https://doi.org/10.1007/s10489-021-02676-w
IF: 5.3
2021-08-23
Applied Intelligence
Abstract:Classification is the most basic and representative problem in data mining and machine learning. In recent years, more and more evolutionary algorithms (EAs) have been used to handle classification problems due to their good global search capabilities. EA-based methods construct an optimization classification model by introducing a linear equations set. Thus, EAs can be used to directly solve classification problems. However, the structure of the existing optimization classification model is closely related to the dimension of datasets, and there are often a lot of redundant, irrelevant, or noise features in the datasets. These features may lead to complex calculation and low learning efficiency, thus affecting the classification performance. Feature selection has superior performance on solving this kind of problems. Therefore, for the optimization classification model, this paper introduces the concept of feature selection and proposes an improved optimization classification model based on both structure search and weight search. Brain storm optimization (BSO) algorithm is used to solve the optimization classification model. On one hand, BSO algorithm is used to search for the optimal classification model structure which is determined by the optimal feature subset. On the other hand, BSO is used to search for the optimal weight vectors under different structures. Thus, BSO is used to search for optimal structure and weights alternately. Experimental results show that feature selection can effectively simplify the structure of the classification model and improve the classification performance. In addition, the experimental results also verify the effectiveness of BSO on searching the corresponding weights under different structures, which can further improve the classification performance.
computer science, artificial intelligence
What problem does this paper attempt to address?