Abstract:In the realm of data analysis and machine learning, achieving an optimal balance of feature importance, known as feature weighting, plays a pivotal role, especially when considering the nuanced interplay between the symmetry of data distribution and the need to assign differential weights to individual features. Also, avoiding the dominance of large-scale traits is essential in data preparation. This step makes choosing an effective normalization approach one of the most challenging aspects of machine learning. In addition to normalization, feature weighting is another strategy to deal with the importance of the different features. One of the strategies to measure the dependency of features is the correlation coefficient. The correlation between features shows the relationship strength between the features. The integration of the normalization method with feature weighting in data transformation for classification has not been extensively studied. The goal is to improve the accuracy of classification methods by striking a balance between the normalization step and assigning greater importance to features with a strong relation to the class feature. To achieve this, we combine Min–Max normalization and weight the features by increasing their values based on their correlation coefficients with the class feature. This paper presents a proposed Correlation Coefficient with Min–Max Weighted (CCMMW) approach. The data being normalized depends on their correlation with the class feature. Logistic regression, support vector machine, k-nearest neighbor, neural network, and naive Bayesian classifiers were used to evaluate the proposed method. Twenty UCI Machine Learning Repository and Kaggle datasets with numerical values were also used in this study. The empirical results showed that the proposed CCMMW significantly improves the classification performance through support vector machine, logistic regression, and neural network classifiers in most datasets.

Optimal Mean Linear Classifier via Weighted Nuclear Norm and <i>L</i><sub>2,1</sub> Norm

Noise-immune Weighted SVM Classification Algorithm

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

Optimal Weighting Distance-Based Similarity for Locally Weighted PLS Modeling

Robust multiclass least squares support vector classifier with optimal error distribution

Image classification based on weighted nonconvex low-rank and discriminant least squares regression

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

Weighted Non-Negative Sparse Low-Rank Representation Classification

Self-weighted Robust LDA for Multiclass Classification with Edge Classes

Kernel Least-Mean Mixed-Norm Algorithm

A Generalized and Robust Nonlinear Approach based on Machine Learning for Intrusion Detection

Improved nearest neighbor classification based on local mean and class mean with modified weights

A Non-Greedy Algorithm Based L1-Norm LDA Method for Fault Detection

The Integrity of Machine Learning Algorithms against Software Defect Prediction

Labeled-Robust Regression: Simultaneous Data Recovery and Classification.

Software Defect Prediction Analysis Using Machine Learning Techniques

Regularized Linear Discriminant Analysis Using a Nonlinear Covariance Matrix Estimator

Subspace Clustering Based on Latent Low Rank Representation with Weighted Nuclear Norm Minimization.

Low-Rank Matrix Recovery from Noise Via an MDL Framework-Based Atomic Norm

A Novel Approach for Data Feature Weighting Using Correlation Coefficients and Min–Max Normalization