Abstract:In this paper, we propose a polynomial kernel neural network classifier (PKNNC) based on the random sampling and information gain. Random sampling is used here to generate datasets for the construction of polynomial neurons located in the neural networks, while information gain is used to evaluate the importance of the input variables (viz. dataset features) of each neuron. Both random sampling and information gain stem from the concepts of well-known random forest models. Some traditional neural networks have certain limitations, such as slow convergence speed, easily falling to local optima and difficulty describing the polynomial relation between the input and output. In this regard, a general PKNNC is proposed, and it consists of three parts: the premise, conclusion, and aggregation. The method of designing the PKNNC is summarized as follows. In the premise section, random sampling and information gain are used to obtain multiple subdatasets that are passed to the aggregation part, and the conclusion part uses three types of polynomials. In the aggregation part, the least squares method (LSM) is used to estimate the parameters of polynomials. Furthermore, the particle swarm optimization (PSO) algorithm is exploited here to optimize the PKNNC. The overall optimization of the PKNNC combines structure optimization and parameter optimization. The PKNNC takes advantage of three types of polynomial kernel functions, random sampling techniques and information gain algorithms, which have a good ability to describe the higher-order nonlinear relationships between input and output variables and have high generalization and fast convergence capabilities. To evaluate the effectiveness of the PKNNC, numerical experiments are carried out on two types of data: machine learning data and face data. A comparative study illustrates that the proposed PKNNC leads to better performance than several conventional models.

An Optimized Neural Network Classification Method Based on Kernel Holistic Learning and Division

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

Data Classification Based on Density Function Estimated by Radial Basis Function

Novel Data Classification Method Based on Radial Basis Function Networks

HCFNN: High-order Coverage Function Neural Network for Image Classification

A Multi-Kernel Mode Using a Local Binary Pattern and Random Patch Convolution for Hyperspectral Image Classification

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

A New Convolutional Kernel Classifier for Hyperspectral Image Classification

Image Classification Method Rationally Utilizing Spatial Information of the Image

Learning Kernel for Conditional Moment-Matching Discrepancy-Based Image Classification

Kernelized dual regression incorporating local information for image set classification

Optimizing Kernel Machines using Deep Learning

A General Kernelization Framework for Learning Algorithms Based on Kernel PCA.

A polynomial kernel neural network classifier based on random sampling and information gain

Optimizing Kernel Transformations to Handle Binary Class Imbalanced Dataset Classification

An Efficient Kernel Evaluation Criterion for Multiclass Classification

Optimized face recognition algorithm using radial basis function neural networks and its practical applications

Optimization-Based Extreme Learning Machine with Multi-kernel Learning Approach for Classification

Hyperspectral remote sensing image classification based on radical basis function neural network

On Valid Optimal Assignment Kernels and Applications to Graph Classification

Efficient knowledge distillation for hybrid models: A vision transformer‐convolutional neural network to convolutional neural network approach for classifying remote sensing images