GBRUN: A Gradient Search-based Binary Runge Kutta Optimizer for Feature Selection

Zhi-Chao Dou Zhi-Chao Dou,Shu-Chuan Chu Zhi-Chao Dou,Zhongjie Zhuang Shu-Chuan Chu,Ali Riza Yildiz Zhongjie Zhuang,Jeng-Shyang Pan Ali Riza Yildiz
DOI: https://doi.org/10.53106/160792642024052503001
2024-05-01
網際網路技術學刊
Abstract:Feature selection (FS) is a pre-processing technique for data dimensionality reduction in machine learning and data mining algorithms. FS technique reduces the number of features and improves the model generalization ability. This study presents a Gradient Search-based Binary Runge Kutta Optimizer (GBRUN) for solving the FS problem of high-dimensional. First, the proposed method converts the continuous Runge Kutta optimizer (RUN) into a binary version through S-, V-, and U-shaped transfer functions. Second, a gradient search method is introduced to improve the exploration capability of the algorithm. Five standard datasets provided by Arizona State University’s Data Mining and Machine Learning Lab were selected to verify the performance of the GBRUN algorithm. The experimental results show that GBRUN has better performance than other advanced algorithms regarding classification accuracy and the number of selected features. Moreover, the GBRUN algorithm is also combined with EfficientNet in this manuscript, using the GBRUN algorithm to select the features extracted by EfficientNet. The results show that the V-shaped (GBRUN-V) and U-shaped (GBRUN-U) algorithms have better performance than other algorithms.  
computer science, information systems,telecommunications
What problem does this paper attempt to address?