Abstract:K-nearest neighbor (KNN) is a lazy supervised learning algorithm, which depends on computing the similarity between the target and the closest neighbor(s). On the other hand, min-max normalization has been reported as a useful method for eliminating the impact of inconsistent ranges among attributes on the efficiency of some machine learning models. The impact of min-max normalization on the performance of KNN models is still not clear, and it needs more investigation. Therefore, this research examines the impacts of the min-max normalization method on the regression performance of KNN models utilizing eight different similarity measures, which are City block, Euclidean, Chebychev, Cosine, Correlation, Hamming, Jaccard, and Mahalanobis. Five benchmark datasets have been used to test the accuracy of the KNN models with the original dataset and the normalized dataset. Mean squared error (MSE) has been utilized as a performance indicator to compare the results. It’s been concluded that the impact of min-max normalization on the KNN models utilizing City block, Euclidean, Chebychev, Cosine, and Correlation depends on the nature of the dataset itself, therefore, testing models on both original and normalized datasets are recommended. The performance of KNN models utilizing Hamming, Jaccard, and Mahalanobis makes no difference by adopting min-max normalization because of their ratio nature, and dataset covariance involvement in the similarity calculations. Results showed that Mahalanobis outperformed the other seven similarity measures. This research is better than its peers in terms of reliability, and quality because it depended on testing different datasets from different application fields.

Optimization of distance formula in K-Nearest Neighbor method

Efficient Estimation of k for the Nearest Neighbors Class of Methods

A Fast and Easy Regression Technique for k-NN Classification Without Using Negative Pairs

Information Modified K-Nearest Neighbor

Adaptive Nearest Neighbor: A General Framework for Distance Metric Learning

p -adic distance and k -Nearest Neighbor classification

K-Ns: A Classifier by the Distance to the Nearest Subspace.

Investigating the Impact of Min-Max Data Normalization on the Regression Performance of K-Nearest Neighbor with Different Similarity Measurements

Introduction to Machine Learning: K-Nearest Neighbors

A Novel Pseudo Nearest Neighbor Classification Method Using Local Harmonic Mean Distance

A feature weighted K-nearest neighbor algorithm based on association rules

Reachable Distance Function for KNN Classification

Enhancing K-nearest neighbor algorithm: a comprehensive review and performance analysis of modifications

Minimax Optimal Algorithms with Fixed-$k$-Nearest Neighbors

Hausdorff distance with k-nearest neighbors

Optimizing Euclidean Distance Computation

Performance analysis of classification between a particular number and average using the same distance measurements

Preprocessing kNN algorithm classification using K-means and distance matrix with students’ academic performance dataset

Efficiently Learning a Distance Metric for Large Margin Nearest Neighbor Classification.

Dynamic Feature Scaling for K-Nearest Neighbor Algorithm

A Novel Effective Distance Measure and a Relevant Algorithm for Optimizing the Initial Cluster Centroids of K-means