Abstract:Algorithms involving kernel functions, such as support vector machine (SVM), have attracted huge attention within the artificial learning communities. The performance of these algorithms is greatly influenced by outliers and the choice of kernel functions. This paper introduces a new version of SVM named Deep Decomposition Neural Network Fuzzy SVM (DDNN-FSVM). To this end, we consider an auto-encoder (AE) deep neural network with three layers: input, hidden, and output. Unusually, the AE's hidden layer comprises a number of neurons greater than the dimension of the input samples, which guarantees linear data separation. The encoder operator is then introduced into the FSVM's dual to map the training samples to high-dimension spaces. To learn the support vectors and autoencoder parameters, we introduce the loss function and regularization terms in the FSVM dual. To learn from large-scale data, we decompose the resulting model into three small-dimensional submodels using Lagrangian decomposition. To solve the resulting problems, we use SMO, ISDA, and SCG for optimization problems involving large-scale data. We demonstrate that the optimal values of the three submodels solved in parallel provide a good lower bound for the optimal value of the initial model. In addition, thanks to its use of fuzzy weights, DDNN-FSVM is resistant to outliers. Moreover, DDNN-FSVM simultaneously learns the appropriate kernel function and separation path. We tested DDNN-FSVM on several well-known digital and image datasets and compared it to well-known classifiers on the basis of accuracy, precision, f-measure, g-means, and recall. On average, DDNN-FSVM improved on the performance of the classic FSVM across all datasets and outperformed several well-known classifiers.

Support Vector Machine Optimized by Fireworks Algorithm for Handwritten Digit Recognition

On-line Handwritten Recognition with Optimized GDTW-SVM Algoriyhm

Handwritten Digit Recognition using Machine and Deep Learning Algorithms

A Machine Learning Framework for Recognizing Handwritten Digits Using Convexity-Based Feature Vector Encoding

Support Vector Machine for Handwritten Character Recognition

Performance analysis of optimization algorithms for convolutional neural network-based handwritten digit recognition

Performance analysis of hybrid deep learning framework using a vision transformer and convolutional neural network for handwritten digit recognition

Pairwise Coupling Support Vector Machine and Its Application on Handwritten Digital Recognition

Optimizing Convolutional Neural Network Hyperparameters by Enhanced Swarm Intelligence Metaheuristics

Hyper-parameter tuning for support vector machine using an improved cat swarm optimization algorithm

Optimization of Regularization and Early Stopping to Reduce Overfitting in Recognition of Handwritten Characters

An Svm-Based Incremental Learning Algorithm for User Adaptation of Sketch Recognition.

Tuning Convolutional Neural Network Hyperparameters by Bare Bones Fireworks Algorithm

Non-Parametric Estimation Of Svm Probabilistic Outputs And Its Application On Handwritten Digital Recognition

Performance Analysis of Support Vector Machine (SVM) on Challenging Datasets for Forest Fire Detection

Optimasi Parameter Support Vector Machine Berbasis Algoritma Firefly Pada Data Opini Film

An Effective Combination of Convolutional Neural Network and Support Vector Machine Classifier for Arabic Handwritten Recognition

Decomposition and Symmetric Kernel Deep Neural Network Fuzzy Support Vector Machine

Support Feature Machines

Comparative Study on Handwritten Digit Recognition Classifier Using CNN and Machine Learning Algorithms

Enhancing Support Vector Machine Performance: A Hybrid Approach with Davidon-Fletcher-Powell Algorithm and Elephant Herding Optimization (EHO-DFP) for Parameter Optimization