Abstract:In the realm of data analysis and machine learning, achieving an optimal balance of feature importance, known as feature weighting, plays a pivotal role, especially when considering the nuanced interplay between the symmetry of data distribution and the need to assign differential weights to individual features. Also, avoiding the dominance of large-scale traits is essential in data preparation. This step makes choosing an effective normalization approach one of the most challenging aspects of machine learning. In addition to normalization, feature weighting is another strategy to deal with the importance of the different features. One of the strategies to measure the dependency of features is the correlation coefficient. The correlation between features shows the relationship strength between the features. The integration of the normalization method with feature weighting in data transformation for classification has not been extensively studied. The goal is to improve the accuracy of classification methods by striking a balance between the normalization step and assigning greater importance to features with a strong relation to the class feature. To achieve this, we combine Min–Max normalization and weight the features by increasing their values based on their correlation coefficients with the class feature. This paper presents a proposed Correlation Coefficient with Min–Max Weighted (CCMMW) approach. The data being normalized depends on their correlation with the class feature. Logistic regression, support vector machine, k-nearest neighbor, neural network, and naive Bayesian classifiers were used to evaluate the proposed method. Twenty UCI Machine Learning Repository and Kaggle datasets with numerical values were also used in this study. The empirical results showed that the proposed CCMMW significantly improves the classification performance through support vector machine, logistic regression, and neural network classifiers in most datasets.

Normalization for Microarray Data: the Weight Function of Local Weight Regression

Normalization Methods for High-Density Oligonucleotide Microarray Data

Normalization of Cdna Microarray Data Using Wavelet Regressions

A Novel Approach for Data Feature Weighting Using Correlation Coefficients and Min–Max Normalization

Laws of Large Numbers for Weighted Sums of Random Variables and Random Elements

A Weighted Support Vector Machine Method and Its Application

Ultra-fine Transformation of Data for Normality

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Use of normalization methods for analysis of microarrays containing a high degree of gene effects

From sparse to dense functional data and beyond

A note on automatic data transformation

Understanding the Disharmony between Weight Normalization Family and Weight Decay: $ε-$shifted $L_2$ Regularizer

A Neural Network-Based Approach to Normality Testing for Dependent Data

Data normalization in machine learning

Parsimonious Seemingly Unrelated Contaminated Normal Cluster-Weighted Models

Extreme Value Distribution Based Gene Selection Criteria for Discriminant Microarray Data Analysis Using Logistic Regression

Optimization and Generalization Guarantees for Weight Normalization

Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting

A flexible generalization of the skew normal distribution based on a weighted normal distribution

On the accuracy of self-normalized log-linear models

A comparison of normalization methods for high density oligonucleotide array data based on variance and bias