Frog-Snake prey-predation Relationship Optimization (FSRO) : A novel nature-inspired metaheuristic algorithm for feature selection

Hayata Saitou,Harumi Haraguchi
2024-02-13
Abstract:Swarm intelligence algorithms have traditionally been designed for continuous optimization problems, and these algorithms have been modified and extended for application to discrete optimization problems. Notably, their application in feature selection for machine learning has demonstrated improvements in model accuracy, reduction of unnecessary data, and decreased computational time. This study proposes the Frog-Snake prey-predation Relationship Optimization (FSRO) algorithm, inspired by the prey-predation relationship between frogs and snakes for application to discrete optimization problems. The algorithm models three stages of a snake's foraging behavior "search", "approach", and "capture" as well as the frog's characteristic behavior of staying still to attract and then escaping. Furthermore, the introduction of the concept of evolutionary game theory enables dynamic control of the search process. The proposed algorithm conducts computational experiments on feature selection using 26 types of machine learning datasets to analyze its performance and identify improvements. In computer experiments, the proposed algorithm showed better performance than the comparison algorithms in terms of the best and standard deviation of fitness value and Accuracy. It was also proved that dynamic search control by evolutionary game theory is an effective method, and the proposed algorithm has the ability of a well-balanced search, achieving the two objectives of improving accuracy and reducing data.
Neural and Evolutionary Computing
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve The paper proposes a new metaheuristic algorithm—Frog-Snake Prey-Predation Relationship Optimization (FSRO), aimed at solving discrete optimization problems, particularly feature selection in machine learning. Specifically, the algorithm is inspired by the prey-predation relationship between frogs and snakes, simulating the three stages of snake foraging behavior: "search," "approach," and "capture," as well as the stationary attraction and escape behavior of frogs. Additionally, the concept of evolutionary game theory is introduced to dynamically control the search process, achieving a better balance between exploration and exploitation capabilities. Through experiments conducted on 26 different machine learning datasets, the paper validates the performance of the FSRO algorithm in feature selection tasks and demonstrates its superiority over other comparison algorithms, especially in terms of the best fitness value, standard deviation, and classification accuracy. Furthermore, the experimental results indicate that evolutionary game theory is an effective method for dynamic search control, enabling the FSRO algorithm to achieve a good balance between improving accuracy and reducing data volume.