Abstract:Support Vector Machines (SVMs) have gained prominence in machine learning for their capability to establish optimal decision boundaries in high-dimensional spaces. SVMs are powerful machine learning models but can encounter difficulties in achieving optimal performance due to challenges such as selecting appropriate kernel parameters, handling uncertain data, and adapting to complex decision boundaries.. This paper introduces a novel hybrid approach to enhance the performance of Support Vector Machines (SVM) through the integration of the Davidon-Fletcher-Powell (DFP) optimization algorithm and Elephant Herding Optimization (EHO) for parameter tuning. SVM, a robust machine learning algorithm, relies on effective hyperparameter selection for optimal performance. The proposed hybrid model synergistically leverages DFP's efficiency in unconstrained optimization and EHO's exploration-exploitation balance inspired by elephant herding behavior. The fusion of these algorithms address the challenges associated with traditional optimization methods. The hybrid model offers improved convergence towards the global optimum. Experimental results demonstrate the efficacy of the approach, showcasing enhanced SVM performance in terms of minimum 3.3% accuracy and 3.4% efficiency. This research contributes to advancing the field of metaheuristic optimization in machine learning, providing a promising avenue for effective parameter optimization in SVM applications.

Comparison of SVM Optimization Techniques in the Primal

A Comparison of First-order Algorithms for Machine Learning

A Review of Optimization Methodologies in Support Vector Machines

Semisupervised Classification of Hyperspectral Images by SVMs Optimized in the Primal.

Comparing two SVM models through different metrics based on the confusion matrix

A New Method for SVM Hyper-parameters Optimization

Enhancing Support Vector Machine Performance: A Hybrid Approach with Davidon-Fletcher-Powell Algorithm and Elephant Herding Optimization (EHO-DFP) for Parameter Optimization

Modified Optimal Foraging Algorithm for Parameters Optimization of Support Vector Machine

Comparative Analysis of Gradient-Based Optimization Techniques Using Multidimensional Surface 3D Visualizations and Initial Point Sensitivity

Hybrid optimization of feature selection and SVM training model

Dual Active Set Method for Support Vector Machines under Multi-Constraint Activation

Comparison of Proximal First-Order Primal and Primal-Dual algorithms via Performance Estimation

A Comparative Study on Four Unconstrained Optimization Algorithms

SVM Parameter Optimization using Grid Search and Genetic Algorithm to Improve Classification Performance

Primal dual algorithm for solving the nonsmooth Twin SVM

Research on Parameters Optimisation of SVM Based on Swarm Intelligence

Quantum-Behaved Particle Swarm Optimization for Parameter Optimization of Support Vector Machine

Classification of hyperspectral remote-sensing data with primal SVM for small-sized training dataset problem

Study on geometric approach of SVM algorithm-SK algorithm analysis and study

Experimental Study on the Performance of Support Vector Machine with Squared Cost Function

SVM algorithm with different error costs based on SMO