Anti-hapten antibody induction with deoxyribonucleic acid carrier.

E. Voss,K. Corley,L. Huang

DOI: https://doi.org/10.1016/0019-2791(69)90293-6

1969-05-01

Immunochemistry

Abstract:

What problem does this paper attempt to address?

A Novel Enhanced Arithmetic Optimization Algorithm for Global Optimization

Jinzhong Zhang,Gang Zhang,Yourui Huang,Min Kong

DOI: https://doi.org/10.1109/ACCESS.2022.3190481

IF: 3.9

2022-01-01

IEEE Access

Abstract:The arithmetic optimization algorithm (AOA) is based on the distribution character of the dominant arithmetic operators and imitates addition (A), subtraction (S), multiplication (M) and division (D) to find the global optimal solution in the entire search space. However, the basic AOA has some drawbacks of premature convergence, easily falls into a local optimal value, slow convergence rate, and low calculation precision. To improve the overall optimization ability and overcome the drawbacks of the basic AOA, an enhanced AOA (EAOA) based on the Levy variation and the differential sorting variation is proposed to solve the function optimization and the project optimization. The Levy variation increases population diversity, broadens the optimization space, enhances the global search ability and improves the calculation precision. The differential sorting variation filters out the optimal search agent, avoids search stagnation, enhances the local search ability and accelerates the convergence rate. The EAOA realizes complementary advantages of the Levy variation and the differential sorting variation to avoid falling into the local optimum and the premature convergence. The sixteen benchmark functions and five engineering design projects are applied to verify the effectiveness and feasibility of the EAOA. The EAOA is compared with other algorithms by minimizing the fitness value, such as artificial bee colony, ant line optimizer, cuckoo search, dragongfly algorithm, moth-flame optimization, sine cosine algorithm, water wave optimization and arithmetic optimization algorithm. The experimental results show that the overall optimization ability of the EAOA is superior to that of other algorithms, the EAOA can effectively balance the exploration and the exploitation to obtain the best solution. In addition, the EAOA has a faster convergence rate, higher calculation precision and stronger stability.
An Efficient Binary Equilibrium Optimizer Algorithm for Feature Selection

Yuanyuan Gao,Yongquan Zhou,Qifang Luo

DOI: https://doi.org/10.1109/access.2020.3013617

IF: 3.9

2020-01-01

IEEE Access

Abstract:Feature selection (FS) is a classic and challenging optimization task in the field of machine learning and data mining. An equilibrium optimizer (EO) is a novel physics-based optimization algorithm; it was inspired by controlled volume mass balance models for estimating dynamic and equilibrium states. This article presents two binary equilibrium optimizer algorithm and for selecting the optimal feature subset for classification problems. The first algorithm maps the continuous EO into a discrete type using S-shaped and V-shaped transfer functions (BEO-S and BEO-V). The second algorithm is based on the position of the current optimal solution (target) and position vector (BEO-T). To verify the performance of the proposed algorithm, 19 well-known UCI datasets are tested and compared with other advanced FS methods. The experimental results show that among the proposed binary EO algorithms, BEO-V2 has the best comprehensive performance and has better performance than other state-of-the-art metaheuristic algorithms in terms of the performance measures.

computer science, information systems,telecommunications,engineering, electrical & electronic
New Binary Archimedes Optimization Algorithm and its application

Lingling Fang,Yutong Yao,Xiyue Liang

DOI: https://doi.org/10.1016/j.eswa.2023.120639

IF: 8.5

2023-06-05

Expert Systems with Applications

Abstract:Optimization problem, as a hot research field, is applied to many industries in the real world. Due to the complexity of different search spaces, metaheuristic optimization algorithms are proposed to solve this problem. As a recently introduced optimization method inspired by physics, Archimedes Optimization Algorithm (AOA) is an efficient metaheuristic algorithm based on Archimedes' law. It has the advantages of fast convergence speed and balance between local and global search ability when solving continuous problems. However, discrete problems exist more in practical applications. AOA needs to be further improved in dealing with such problems. On this basis, to make Archimedes Optimization Algorithm better applied to solve discrete problems, a Binary Archimedes Optimization Algorithm (BAOA) is proposed in this paper, which incorporates a novel V-shaped transfer function. The proposed method applies the BAOA to COVID-19 classification of medical data, segmentation of real brain lesion, and the knapsack problem. The experimental results show that the proposed BAOA can solve the discrete problem well.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Binary Sine Cosine Algorithms for Feature Selection from Medical Data

Shokooh Taghian,Mohammad H. Nadimi-Shahraki

DOI: https://doi.org/10.5121/acij.2019.10501

2019-11-15

Abstract:A well-constructed classification model highly depends on input feature subsets from a dataset, which may contain redundant, irrelevant, or noisy features. This challenge can be worse while dealing with medical datasets. The main aim of feature selection as a pre-processing task is to eliminate these features and select the most effective ones. In the literature, metaheuristic algorithms show a successful performance to find optimal feature subsets. In this paper, two binary metaheuristic algorithms named S-shaped binary Sine Cosine Algorithm (SBSCA) and V-shaped binary Sine Cosine Algorithm (VBSCA) are proposed for feature selection from the medical data. In these algorithms, the search space remains continuous, while a binary position vector is generated by two transfer functions S-shaped and V-shaped for each solution. The proposed algorithms are compared with four latest binary optimization algorithms over five medical datasets from the UCI repository. The experimental results confirm that using both bSCA variants enhance the accuracy of classification on these medical datasets compared to four other algorithms.

Machine Learning,Neural and Evolutionary Computing
Improved Binary Meerkat Optimization Algorithm for efficient feature selection of supervised learning classification

Reda M. Hussien,Amr A. Abohany,Amr A. Abd El-Mageed,Khalid M. Hosny

DOI: https://doi.org/10.1016/j.knosys.2024.111616

IF: 8.139

2024-03-09

Knowledge-Based Systems

Abstract:Feature selection (FS) is a crucial step in machine learning and data mining projects. It aims to remove redundant and uncorrelated features, thus improving the accuracy of models. However, it can be challenging to select the optimal features, especially for datasets with many features. This paper proposes the Binary Meerkat Optimization Algorithm (BMOA) to address the issue of FS. The BMOA selects the most related and useful features. Additionally, an improved BMOA (IBMOA) is introduced, which enhances exploration and exploitation capabilities by incorporating the Periodic Mode Boundary Handling (PMBH) strategy and the Local Search (LS) process. This helps to reduce dimensionality and enhance classification accuracy. To evaluate the significance of selected features, two widely used classifiers, namely k -nearest Neighbor ( k -NN) and Support Vector Machine (SVM), were used as quality raters. The proposed IBMOA and the original BMOA were compared on 21 multi-scale and multi-faceted benchmark datasets. The binary structures of eight contemporary algorithms, including Binary Artificial Bee Colony (BABC), Binary Grey Wolf Optimization (BGWO), Binary Sailfish Optimizer (BSFO), Binary Particle Swarm Optimizer (BPSO), Binary Bird Swarm Algorithm (BBSA), Binary Whale Optimization Algorithm (BWOA), Binary Grasshopper Optimization Algorithm (BGOA), and Binary Bat Algorithm (BBA), were also analyzed and compared. The proposed IBMOA algorithm outperforms competitors on small and large datasets, obtaining optimal solutions within a reasonable timeframe. This is true for the proposed IBMOA, which has been statistically proven to be highly competitive using the Wilcoxon rank sum test (with alpha=0.05).

computer science, artificial intelligence
Binary Social Mimic Optimization Algorithm With X-Shaped Transfer Function for Feature Selection

Kushal Kanti Ghosh,Pawan Kumar Singh,Junhee Hong,Zong Woo Geem,Ram Sarkar

DOI: https://doi.org/10.1109/access.2020.2996611

IF: 3.9

2020-01-01

IEEE Access

Abstract:Definitive optimization algorithms are not able to solve high dimensional optimization problems when the search space grows exponentially with the problem size, and an exhaustive search also becomes impractical. To encounter this problem, researchers use approximation algorithms. A category of approximation algorithms is meta-heuristic algorithms which have shown an acceptable degree of efficiency to solve this kind of problems. Social Mimic Optimization (SMO) algorithm is a recently proposed meta-heuristic algorithm which is used to optimize problems with continuous solution space. It is proposed by following the behavior of people in society. SMO can efficiently explore the solution space for obtaining optimal or near-optimal solution by minimizing a given fitness function. Feature selection is a binary optimization problem where the aim is to maximize the classification accuracy of a learning algorithm using minimum the number of features. To convert the continuous search space to a binary one, a proper transfer function is required. The effect a transfer function has on the binary variant of an optimization algorithm is very important since selecting a particular subset of features based on the solution values attained by the algorithm in continuous search space depends on the considered transfer function. To this end, we have proposed a new transfer function, namely X-shaped transfer function, to enhance the exploration and exploitation ability of binary SMO. The proposed X-shaped transfer function utilizes two components and crossover operation to obtain a new solution. Effect of the proposed X-shaped transfer function is compared with the effect of four S-shaped and four V-shaped transfer functions on SMO in terms of achieved classification accuracy, rate of convergence, and number of features selected over 18 standard UCI datasets. The proposed algorithm is also compared with state-of-the-art meta-heuristic feature selection (FS) algorithms- Experimental results confirm the efficiency of the proposed approach in improving the classification accuracy compared to other meta-heuristic algorithms, and the superiority of X-shaped transfer function over commonly used S-shaped and V-shaped transfer functions. The source code of the proposed method along with the datasets used can be found at https://github.com/Rangerix/SocialMimic.

computer science, information systems,telecommunications,engineering, electrical & electronic
An improved binary snake optimizer with Gaussian mutation transfer function and hamming distance for feature selection

Xinyu Bao,Hui Kang,Hongjuan Li

DOI: https://doi.org/10.1007/s00521-024-09581-6

2024-03-07

Neural Computing and Applications

Abstract:The snake optimizer (SO) is a highly efficient bio-inspired algorithm for solving continuous optimization problems. This algorithm mathematically simulates the unique foraging and mating behaviors observed in snake populations in nature. However, this algorithm cannot be directly applied to solve binary optimization problems, such as feature selection. Feature selection is a significant data preprocessing step in data mining, aimed at reducing data dimensionality, lowering computational costs in terms of time and space, and improving the predictive accuracy of classifiers. To address this limitation, an improved binary version of SO (IBSO) is proposed for feature selection, which incorporates the concept of hamming distance and introduces a novel mutation transfer function (MTF). IBSO extends the application of the conventional SO to binary optimization problems by introducing hamming distance and presents a new binary position update strategy. Furthermore, IBSO utilizes a MTF based on a Gaussian distribution. The MTF not only transforms each dimension of each individual in the population into binary space but also enhances the local random search capability and increases the population diversity of the algorithm. Finally, the experiment is conducted on 27 standard benchmark datasets from UC Irvine Machine Learning Repository and IBSO is compared with several state-of-the-art binary swarm intelligence algorithms to analyze the effectiveness and efficiency of IBSO. The results show that IBSO can obtain the best fitness values with less CPU time. Besides, to evaluate the validity of the proposed MTF, IBSO is compared with other binary versions of SO with different well-known transfer functions.

computer science, artificial intelligence
TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

Lin Sun,Xinya Wang,Weiping Ding,Jiucheng Xu,Huili Meng

DOI: https://doi.org/10.1007/s13042-022-01653-0

2023-01-26

International Journal of Machine Learning and Cybernetics

Abstract:The optimal global feature subset cannot be found easily due to the high cost, and most swarm intelligence optimization-based feature selection methods are inefficient in handling high-dimensional data. In this study, a two-stage feature selection model based on fuzzy neighborhood rough sets (FNRS) and binary whale optimization algorithm (BWOA) is developed. First, to denote the fuzziness of samples for mixed data with symbolic and numerical features, fuzzy neighborhood similarity is presented to study the similarity matrix and fuzzy membership degree, and the lower and upper approximations can be developed to present new FNRS model. Fuzzy neighborhood-based uncertainty measures such as dependence degree, knowledge granularity, and entropy measures are studied. From the viewpoints of algebra and information, fuzzy knowledge granularity conditional entropy is presented to form a preselected feature reduction set in the first stage. Second, the cosine curve change is added to develop a new control factor, which slows down the convergence rate of BWOA in the early iteration to fully explore the global, and accelerates the convergence rate in the late iteration. Integrating dependence degree with fuzzy knowledge granularity conditional entropy, a new fitness function is designed for selecting an optimal feature subset in this second stage. Two strategies are fused to avoid BWOA falling into the local optimum: the population partition strategy with the adaptive neighborhood search radius to divide the whale population and the local interference strategy of the elite subgroup to adjust the whale position update. Finally, a two-stage feature selection algorithm is designed, where the Fisher score algorithm is employed to preliminarily delete those redundancy features of high-dimensional datasets. Experiments on six UCI datasets and five gene expression datasets show that our algorithm is valid compared to other related algorithms.
Binary chemical reaction optimization based feature selection techniques for machine learning classification problems

P.C. Srinivasa Rao,A.J. Sravan Kumar,Quamar Niyaz,Paheding Sidike,Vijay K Devabhaktuni

DOI: https://doi.org/10.1016/j.eswa.2020.114169

IF: 8.5

2021-04-01

Expert Systems with Applications

Abstract:Feature selection is an important pre-processing technique for dimensionality reduction of high-dimensional data in machine learning (ML) field. In this paper, we propose a binary chemical reaction optimization (BCRO) and a hybrid binary chemical reaction optimization-binary particle swarm optimization (HBCRO-BPSO) based feature selection techniques to optimize the number of selected features and improve the classification accuracy. Three objective functions have been used for the proposed feature selection techniques to compare their performances with a BPSO and advanced binary ant colony optimization (ABACO) along with an implemented GA based feature selection approach called as binary genetic algorithm (BGA). Five ML algorithms including K-nearest neighbor (KNN), logistic regression, Naïve Bayes, decision tree, and random forest are considered for classification tasks. Experimental results tested on eleven benchmark datasets from UCI ML repository show that the proposed HBCRO-BPSO algorithm improves the average percentage of reduction in features (APRF) and average percentage of improvement in accuracy (APIA) by 5.01% and 3.83%, respectively over the existing BPSO based feature selection method; 4.58% and 3.12% over BGA; and 4.15% and 2.27% over ABACO when used with a KNN classifier.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Multi-objective optimization algorithm based on clustering guided binary equilibrium optimizer and NSGA-III to solve high-dimensional feature selection problem

Min Zhang,Jie-Sheng Wang,Yu Liu,Hao-Ming Song,Jia-Ning Hou,Yu-Cai Wang,Min Wang

DOI: https://doi.org/10.1016/j.ins.2023.119638

IF: 8.1

2023-09-06

Information Sciences

Abstract:Feature selection (FS) is an indispensable activity in machine learning , whose purpose is to identify relevant predictive values from a high-dimensional feature space to improve performance and reduce model learning time. However, the large increase in feature dimensions poses a great challenge to FS methods. Therefore, a multi-objective optimization algorithm consisting of an Equilibrium Optimizer (EO) and NSGA-III was proposed to solve the FS problem with high-dimensional data. Through S-shaped, V-shaped and U-shaped transfer functions, the conversion from real number coding to binary coding is realized to solve discrete problems, and the influence of these three transfer functions on the effect of FS is compared. In addition, the algorithm optimizes the population in the binary search space by building an external archive , and realizes the selection and optimization of external archive individuals based on the clustering strategy. The KNN classifier was used to realize the classification progress. The simulation experiments are divided into two groups with 18 medium and high dimensional data. The first group analyzes the optimization effect of the proposed framework under three transfer functions. The second group of experiments selects the algorithm that wins in the first group of experiments and compares it with eleven classical multi-objective optimization algorithms. The evaluation criteria includes two optimization objectives of the FS problem and the optimization indices of HV and IGD. The first set of experiments showed that the U-shaped transfer function family performed best in the FS problem, with U3 being the most excellent, followed by V-shaped and S-shaped. Compared to other multi-objective optimization algorithms, the simulation results also confirm the effectiveness of the proposed strategy.

computer science, information systems
Feature selection using binary monarch butterfly optimization

Lin Sun,Shanshan Si,Jing Zhao,Jiucheng Xu,Yaojin Lin,Zhiying Lv

DOI: https://doi.org/10.1007/s10489-022-03554-9

IF: 5.3

2022-04-20

Applied Intelligence

Abstract:Swarm intelligence algorithms have superior performance in searching for the optimal feature subset, where Monarch Butterfly Optimization (MBO) can solve the continuous optimization problem. However, there exist some defects for MBO such as the limited searchable positions, falling into local optimum easily and unsolved binary variables. To address these drawbacks, this paper develops two mechanisms to propose several revisions of binary MBO (BMBO) for metaheuristic feature selection. First, to make MBO suitable to solve the feature selection optimization problems, the S-shaped and V-shaped transfer functions are introduced to convert continuous space into binary, and then force the butterfly to move in the binary search space. Two updated positions of the monarch butterfly population are designed based on these above transfer functions respectively to construct two BMBO models, namely BMBO-S and BMBO-V, as the first mechanism of BMBO. Second, the new step length parameter is proposed to update the position of monarch butterfly individuals. To prevent MBO from falling into the local optimum, the local disturbance and group division strategies are added into MBO to construct new BMBO method. It follows that a mutation rate is employed to enhance the detection stage of BMBO, and the mutation operator-based BMBO (BMBO-M) is designed to avoid the premature convergence of MBO. Third, this fitness function is integrated with the KNN classifier and the weight of the feature subset length to rank the selected feature subset, and a metaheuristic feature selection algorithm with BMBO-M is developed. Experiments applied to nineteen low dimensional UCI datasets and seven high dimensional datasets demonstrate our designed algorithm has great classification efficiency when compared with the other related technologies.

computer science, artificial intelligence
An Improved Binary Walrus Optimizer with Golden Sine Disturbance and Population Regeneration Mechanism to Solve Feature Selection Problems

Yanyu Geng,Ying Li,Chunyan Deng

DOI: https://doi.org/10.3390/biomimetics9080501

2024-08-18

Abstract:Feature selection (FS) is a significant dimensionality reduction technique in machine learning and data mining that is adept at managing high-dimensional data efficiently and enhancing model performance. Metaheuristic algorithms have become one of the most promising solutions in FS owing to their powerful search capabilities as well as their performance. In this paper, the novel improved binary walrus optimizer (WO) algorithm utilizing the golden sine strategy, elite opposition-based learning (EOBL), and population regeneration mechanism (BGEPWO) is proposed for FS. First, the population is initialized using an iterative chaotic map with infinite collapses (ICMIC) chaotic map to improve the diversity. Second, a safe signal is obtained by introducing an adaptive operator to enhance the stability of the WO and optimize the trade-off between exploration and exploitation of the algorithm. Third, BGEPWO innovatively designs a population regeneration mechanism to continuously eliminate hopeless individuals and generate new promising ones, which keeps the population moving toward the optimal solution and accelerates the convergence process. Fourth, EOBL is used to guide the escape behavior of the walrus to expand the search range. Finally, the golden sine strategy is utilized for perturbing the population in the late iteration to improve the algorithm's capacity to evade local optima. The BGEPWO algorithm underwent evaluation on 21 datasets of different sizes and was compared with the BWO algorithm and 10 other representative optimization algorithms. The experimental results demonstrate that BGEPWO outperforms these competing algorithms in terms of fitness value, number of selected features, and F1-score in most datasets. The proposed algorithm achieves higher accuracy, better feature reduction ability, and stronger convergence by increasing population diversity, continuously balancing exploration and exploitation processes and effectively escaping local optimal traps.
BGOA-TVG: Binary Grasshopper Optimization Algorithm with Time-Varying Gaussian Transfer Functions for Feature Selection

Mengjun Li,Qifang Luo,Yongquan Zhou

DOI: https://doi.org/10.3390/biomimetics9030187

2024-03-20

Biomimetics

Abstract:Feature selection aims to select crucial features to improve classification accuracy in machine learning and data mining. In this paper, a new binary grasshopper optimization algorithm using time-varying Gaussian transfer functions (BGOA-TVG) is proposed for feature selection. Compared with the traditional S-shaped and V-shaped transfer functions, the proposed Gaussian time-varying transfer functions have the characteristics of a fast convergence speed and a strong global search capability to convert a continuous search space to a binary one. The BGOA-TVG is tested and compared to S-shaped and V-shaped binary grasshopper optimization algorithms and five state-of-the-art swarm intelligence algorithms for feature selection. The experimental results show that the BGOA-TVG has better performance in UCI, DEAP, and EPILEPSY datasets for feature selection.
Benchmarking Feature-based Algorithm Selection Systems for Black-box Numerical Optimization

Ryoji Tanabe

DOI: https://doi.org/10.1109/TEVC.2022.3169770

2022-04-26

Abstract:Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently received attention in the research field of black-box numerical optimization. However, there is still room for analysis of algorithm selection for black-box optimization. Most previous studies have focused only on whether an algorithm selection system can outperform the single-best solver in a portfolio. In addition, a benchmarking methodology for algorithm selection systems has not been well investigated in the literature. In this context, this paper analyzes algorithm selection systems on the 24 noiseless black-box optimization benchmarking functions. First, we demonstrate that the first successful performance measure is more reliable than the expected runtime measure for benchmarking algorithm selection systems. Then, we examine the influence of randomness on the performance of algorithm selection systems. We also show that the performance of algorithm selection systems can be significantly improved by using sequential least squares programming as a pre-solver. We point out that the difficulty of outperforming the single-best solver depends on algorithm portfolios, cross-validation methods, and dimensions. Finally, we demonstrate that the effectiveness of algorithm portfolios depends on various factors. These findings provide fundamental insights for algorithm selection for black-box optimization.

Neural and Evolutionary Computing
EBBA: An Enhanced Binary Bat Algorithm Integrated with Chaos Theory and Levy Flight for Feature Selection

Jinghui Feng,Haopeng Kuang,Lihua Zhang

DOI: https://doi.org/10.3390/fi14060178

2022-01-01

Future Internet

Abstract:Feature selection can efficiently improve classification accuracy and reduce the dimension of datasets. However, feature selection is a challenging and complex task that requires a high-performance optimization algorithm. In this paper, we propose an enhanced binary bat algorithm (EBBA) which is originated from the conventional binary bat algorithm (BBA) as the learning algorithm in a wrapper-based feature selection model. First, we model the feature selection problem and then transfer it as a fitness function. Then, we propose an EBBA for solving the feature selection problem. In EBBA, we introduce the Levy flight-based global search method, population diversity boosting method and chaos-based loudness method to improve the BA and make it more applicable to feature selection problems. Finally, the simulations are conducted to evaluate the proposed EBBA and the simulation results demonstrate that the proposed EBBA outmatches other comparison benchmarks. Moreover, we also illustrate the effectiveness of the proposed improved factors by tests.
Explorative Binary Gray Wolf Optimizer with Quadratic Interpolation for Feature Selection

Yijie Zhang,Yuhang Cai

DOI: https://doi.org/10.3390/biomimetics9100648

2024-10-21

Abstract:The high dimensionality of large datasets can severely impact the data mining process. Therefore, feature selection becomes an essential preprocessing stage, aimed at reducing the dimensionality of the dataset by selecting the most informative features while improving classification accuracy. This paper proposes a novel binary Gray Wolf Optimization algorithm to address the feature selection problem in classification tasks. Firstly, the historical optimal position of the search agent helps explore more promising areas. Therefore, by linearly combining the best positions of the search agents, the algorithm's exploration capability is increased, thus enhancing its global development ability. Secondly, the novel quadratic interpolation technique, which integrates population diversity with local exploitation, helps improve both the diversity of the population and the convergence accuracy. Thirdly, chaotic perturbations (small random fluctuations) applied to the convergence factor during the exploration phase further help avoid premature convergence and promote exploration of the search space. Finally, a novel transfer function processes feature information differently at various stages, enabling the algorithm to search and optimize effectively in the binary space, thereby selecting the optimal feature subset. The proposed method employs a k-nearest neighbor classifier and evaluates performance through 10-fold cross-validation across 32 datasets. Experimental results, compared with other advanced algorithms, demonstrate the effectiveness of the proposed algorithm.
Opposition-based sine cosine optimizer utilizing refraction learning and variable neighborhood search for feature selection

Bilal H. Abed-alguni,Noor Aldeen Alawad,Mohammed Azmi Al-Betar,David Paul

DOI: https://doi.org/10.1007/s10489-022-04201-z

IF: 5.3

2022-10-09

Applied Intelligence

Abstract:This paper proposes new improved binary versions of the Sine Cosine Algorithm (SCA) for the Feature Selection (FS) problem. FS is an essential machine learning and data mining task of choosing a subset of highly discriminating features from noisy, irrelevant, high-dimensional, and redundant features to best represent a dataset. SCA is a recent metaheuristic algorithm established to emulate a model based on sine and cosine trigonometric functions. It was initially proposed to tackle problems in the continuous domain. The SCA has been modified to Binary SCA (BSCA) to deal with the binary domain of the FS problem. To improve the performance of BSCA, three accumulative improved variations are proposed (i.e., IBSCA1, IBSCA2, and IBSCA3) where the last version has the best performance. IBSCA1 employs Opposition Based Learning (OBL) to help ensure a diverse population of candidate solutions. IBSCA2 improves IBSCA1 by adding Variable Neighborhood Search (VNS) and Laplace distribution to support several mutation methods. IBSCA3 improves IBSCA2 by optimizing the best candidate solution using Refraction Learning (RL), a novel OBL approach based on light refraction. For performance evaluation, 19 real-wold datasets, including a COVID-19 dataset, were selected with different numbers of features, classes, and instances. Three performance measurements have been used to test the IBSCA versions: classification accuracy, number of features, and fitness values. Furthermore, the performance of the last variation of IBSCA3 is compared against 28 existing popular algorithms. Interestingly, IBCSA3 outperformed almost all comparative methods in terms of classification accuracy and fitness values. At the same time, it was ranked 15 out of 19 in terms of number of features. The overall simulation and statistical results indicate that IBSCA3 performs better than the other algorithms.

computer science, artificial intelligence
A New Hybrid Improved Arithmetic Optimization Algorithm for Solving Global and Engineering Optimization Problems

Zhang,Xing

DOI: https://doi.org/10.3390/math12203221

IF: 2.4

2024-10-15

Mathematics

Abstract:The Arithmetic Optimization Algorithm (AOA) is a novel metaheuristic inspired by mathematical arithmetic operators. Due to its simple structure and flexible parameter adjustment, the AOA has been applied to solve various engineering problems. However, the AOA still faces challenges such as poor exploitation ability and a tendency to fall into local optima, especially in complex, high-dimensional problems. In this paper, we propose a Hybrid Improved Arithmetic Optimization Algorithm (HIAOA) to address the issues of susceptibility to local optima in AOAs. First, grey wolf optimization is incorporated into the AOAs, where the group hunting behavior of GWO allows multiple individuals to perform local searches at the same time, enabling the solution to be more finely tuned and avoiding over-concentration in a particular region, which can improve the exploitation capability of the AOA. Second, at the end of each AOA run, the follower mechanism and the Cauchy mutation operation of the Sparrow Search Algorithm are selected with the same probability and perturbed to enhance the ability of the AOA to escape from the local optimum. The overall performance of the improved algorithm is assessed by selecting 23 benchmark functions and using the Wilcoxon rank-sum test. The results of the HIAOA are compared with other intelligent optimization algorithms. Furthermore, the HIAOA can also solve three engineering design problems successfully, demonstrating its competitiveness. According to the experimental results, the HIAOA has better test results than the comparator.

mathematics
RG-NBEO: a ReliefF guided novel binary equilibrium optimizer with opposition-based S-shaped and V-shaped transfer functions for feature selection

Min Zhang,Jie-Sheng Wang,Jia-Ning Hou,Hao-Ming Song,Xu-Dong Li,Fu-Jun Guo

DOI: https://doi.org/10.1007/s10462-022-10333-y

IF: 9.588

2022-11-28

Artificial Intelligence Review

Abstract:In most data mining tasks, feature selection (FS) is a necessary preprocessing step that can reduce the dimensionality of the dataset while ensuring adequate classification accuracy. In this paper, a ReliefF-guided novel binary equilibrium optimizer (RG-NBEO) is proposed for feature selection. Based on the binary equilibrium optimizer, two novel mechanisms are employed to improve the evolution performance. First, two novel transfer functions (SSr and VVr) based on the concept of opposition learning are proposed to transform the continuous search space into a binary search space and achieve a good balance between exploration and exploitation. Second, a ReliefF bootstrapping strategy is proposed to add and remove features directionally in the iterative process according to the feature weights. The simulation experiments are first based on the equilibrium optimizer (EO) variants constructed from the classical S- and V-shaped transfer functions. The variant EO with the best performance is selected and compared with five superior swarm intelligence optimization algorithms and six classical filter feature selection algorithms. The performance of the proposed method was tested on 18 standard datasets, and the results of the different algorithms were statistically evaluated using the Wilcoxon rank sum test and the Freidman rank sum test. The results show that this method can effectively improve the classification accuracy in most cases.

computer science, artificial intelligence
S-Shaped vs. V-Shaped Transfer Functions for Antlion Optimization Algorithm in Feature Selection Problems

Majdi Mafarja,Seyedali Mirjalili

DOI: https://doi.org/10.1145/3102304.3102325

2017-12-06

Abstract:Feature selection is an important preprocessing step for classification problems. It deals with selecting near optimal features in the original dataset. Feature selection is an NP-hard problem, so meta-heuristics can be more efficient than exact methods. In this work, Ant Lion Optimizer (ALO), which is a recent metaheuristic algorithm, is employed as a wrapper feature selection method. Six variants of ALO are proposed where each employ a transfer function to map a continuous search space to a discrete search space. The performance of the proposed approaches is tested on eighteen UCI datasets and compared to a number of existing approaches in the literature: Particle Swarm Optimization, Gravitational Search Algorithm, and two existing ALO-based approaches. Computational experiments show that the proposed approaches efficiently explore the feature space and select the most informative features, which help to improve the classification accuracy.

Artificial Intelligence

Anti-hapten antibody induction with deoxyribonucleic acid carrier.

A Novel Enhanced Arithmetic Optimization Algorithm for Global Optimization

An Efficient Binary Equilibrium Optimizer Algorithm for Feature Selection

New Binary Archimedes Optimization Algorithm and its application

Binary Sine Cosine Algorithms for Feature Selection from Medical Data

Improved Binary Meerkat Optimization Algorithm for efficient feature selection of supervised learning classification

Binary Social Mimic Optimization Algorithm With X-Shaped Transfer Function for Feature Selection

An improved binary snake optimizer with Gaussian mutation transfer function and hamming distance for feature selection

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

Binary chemical reaction optimization based feature selection techniques for machine learning classification problems

Multi-objective optimization algorithm based on clustering guided binary equilibrium optimizer and NSGA-III to solve high-dimensional feature selection problem

Feature selection using binary monarch butterfly optimization

An Improved Binary Walrus Optimizer with Golden Sine Disturbance and Population Regeneration Mechanism to Solve Feature Selection Problems

BGOA-TVG: Binary Grasshopper Optimization Algorithm with Time-Varying Gaussian Transfer Functions for Feature Selection

Benchmarking Feature-based Algorithm Selection Systems for Black-box Numerical Optimization

EBBA: An Enhanced Binary Bat Algorithm Integrated with Chaos Theory and Levy Flight for Feature Selection

Explorative Binary Gray Wolf Optimizer with Quadratic Interpolation for Feature Selection

Opposition-based sine cosine optimizer utilizing refraction learning and variable neighborhood search for feature selection

A New Hybrid Improved Arithmetic Optimization Algorithm for Solving Global and Engineering Optimization Problems

RG-NBEO: a ReliefF guided novel binary equilibrium optimizer with opposition-based S-shaped and V-shaped transfer functions for feature selection

S-Shaped vs. V-Shaped Transfer Functions for Antlion Optimization Algorithm in Feature Selection Problems