Abstract:In the realm of data analysis and machine learning, achieving an optimal balance of feature importance, known as feature weighting, plays a pivotal role, especially when considering the nuanced interplay between the symmetry of data distribution and the need to assign differential weights to individual features. Also, avoiding the dominance of large-scale traits is essential in data preparation. This step makes choosing an effective normalization approach one of the most challenging aspects of machine learning. In addition to normalization, feature weighting is another strategy to deal with the importance of the different features. One of the strategies to measure the dependency of features is the correlation coefficient. The correlation between features shows the relationship strength between the features. The integration of the normalization method with feature weighting in data transformation for classification has not been extensively studied. The goal is to improve the accuracy of classification methods by striking a balance between the normalization step and assigning greater importance to features with a strong relation to the class feature. To achieve this, we combine Min–Max normalization and weight the features by increasing their values based on their correlation coefficients with the class feature. This paper presents a proposed Correlation Coefficient with Min–Max Weighted (CCMMW) approach. The data being normalized depends on their correlation with the class feature. Logistic regression, support vector machine, k-nearest neighbor, neural network, and naive Bayesian classifiers were used to evaluate the proposed method. Twenty UCI Machine Learning Repository and Kaggle datasets with numerical values were also used in this study. The empirical results showed that the proposed CCMMW significantly improves the classification performance through support vector machine, logistic regression, and neural network classifiers in most datasets.

A study on the effect of scaling functions to feature weighting performance.

Feature Weighting Based on L-GEM

Automatic Coefficient Selection in Weighted Maximum Margin Criterion

Weight Rescaling: Effective and Robust Regularization for Deep Neural Networks with Batch Normalization

A Comparative Study of Neural-Network Feature Weighting

Effective Neural Network Training with a New Weighting Mechanism-Based Optimization Algorithm.

Feature Rescaling of Support Vector Machines

Feature Selection Via Scaling Factor Integrated Multi-Class Support Vector Machines

Scaling the kernel function to improve performance of the support vector machine

Information-Theoretic Foundations for Neural Scaling Laws

A Review and Empirical Evaluation of Feature Weighting Methods for a Class of Lazy Learning Algorithms

Influences of variable scales and activation functions on the performances of multilayer feedforward neural networks

Scale Equalization for Multi-Level Feature Fusion

AutoScale: Automatic Prediction of Compute-optimal Data Composition for Training LLMs

Effective scaling registration approach by imposing the emphasis on the scale factor

Impact of Scaled Image on Robustness of Deep Neural Networks

Learning to Auto Weight: Entirely Data-Driven and Highly Efficient Weighting Framework

A feature group weighting method for subspace clustering of high-dimensional data

Dynamic Feature Scaling for K-Nearest Neighbor Algorithm

A Novel Approach for Data Feature Weighting Using Correlation Coefficients and Min–Max Normalization

Feature Weighting Algorithm Based on Margin and Linear Programming