Abstract:In this paper, we propose a polynomial kernel neural network classifier (PKNNC) based on the random sampling and information gain. Random sampling is used here to generate datasets for the construction of polynomial neurons located in the neural networks, while information gain is used to evaluate the importance of the input variables (viz. dataset features) of each neuron. Both random sampling and information gain stem from the concepts of well-known random forest models. Some traditional neural networks have certain limitations, such as slow convergence speed, easily falling to local optima and difficulty describing the polynomial relation between the input and output. In this regard, a general PKNNC is proposed, and it consists of three parts: the premise, conclusion, and aggregation. The method of designing the PKNNC is summarized as follows. In the premise section, random sampling and information gain are used to obtain multiple subdatasets that are passed to the aggregation part, and the conclusion part uses three types of polynomials. In the aggregation part, the least squares method (LSM) is used to estimate the parameters of polynomials. Furthermore, the particle swarm optimization (PSO) algorithm is exploited here to optimize the PKNNC. The overall optimization of the PKNNC combines structure optimization and parameter optimization. The PKNNC takes advantage of three types of polynomial kernel functions, random sampling techniques and information gain algorithms, which have a good ability to describe the higher-order nonlinear relationships between input and output variables and have high generalization and fast convergence capabilities. To evaluate the effectiveness of the PKNNC, numerical experiments are carried out on two types of data: machine learning data and face data. A comparative study illustrates that the proposed PKNNC leads to better performance than several conventional models.

Component-based Global K-Nn Classifier for Small Sample Size Problems.

K Nearest Neighbor Based Local Sparse Representation Classifier

K-Ns: A Classifier by the Distance to the Nearest Subspace.

A Local Mean Representation-based K-Nearest Neighbor Classifier

Coarse to Fine K Nearest Neighbor Classifier

Learning K for Knn Classification

Kernelized Pyramid Nearest-Neighbor Search for Object Categorization

A Novel Locally Linear Knn Model For Visual Recognition

Multi-view Local Linear KNN Classification: Theoretical and Experimental Studies on Image Classification

The Extended Nearest Neighbor Classification

A Fast Document Classification Algorithm Based on Improved KNN

A New K-Harmonic Nearest Neighbor Classifier Based on the Multi-Local Means

Fast Neighborhood Component Analysis.

Nonparametric Classification Based on Local Mean and Class Mean

Local Linear Regression Classifier for Image Recognition

An Efficient Kernel-Based Nonlinear Regression Method For Two-Class Classification

A New Locally Adaptive K-Nearest Neighbor Algorithm Based on Discrimination Class

A polynomial kernel neural network classifier based on random sampling and information gain

A new general nearest neighbor classification based on the mutual neighborhood information.

A New Locally Linear KNN Method with an Improved Marginal Fisher Analysis for Image Classification

Hybrid k-Nearest Neighbor Classifier.