Abstract:The classification of imbalanced datasets is a prominent task in text mining and machine learning. The number of samples in each class is not uniformly distributed; one class contains a large number of samples while the other has a small number. Overfitting of the model occurs as a result of imbalanced datasets, resulting in poor performance. In this study, we compare different oversampling techniques like synthetic minority oversampling technique (SMOTE), support vector machine SMOTE (SVM-SMOTE), Border-line SMOTE, K-means SMOTE, and adaptive synthetic (ADASYN) oversampling to address the issue of imbalanced datasets and enhance the performance of machine learning models. Preprocessing significantly enhances the quality of input data by reducing noise, redundant data, and unnecessary data. This enables the machines to identify crucial patterns that facilitate the extraction of significant and pertinent information from the preprocessed data. This study preprocesses the data using various top-level preprocessing steps. Furthermore, two imbalanced Twitter datasets are used to compare the performance of oversampling techniques with six machine learning models including random forest (RF), SVM, K-nearest neighbor (KNN), AdaBoost (ADA), logistic regression (LR), and decision tree (DT). In addition, the bag of words (BoW) and term frequency and inverse document frequency (TF-IDF) features extraction approaches are used to extract features from the tweets. The experiments indicate that SMOTE and ADASYN perform much better than other techniques thus providing higher accuracy. Additionally, overall results show that SVM with 'linear' kernel tends to attain the highest accuracy and recall score of 99.67% and 1.00% on ADASYN oversampled datasets and 99.57% accuracy on SMOTE oversampled dataset with TF-IDF features. The SVM model using 10-fold cross-validation experiments achieved 97.40 mean accuracy with a 0.008 standard deviation. Our approach achieved 2.62% greater accuracy as compared to other current methods.

Improving SVM Classification with Imbalance Data Set

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Improved SVM algorithm for imbalanced dataset classification

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Instance Importance Based SVM for Solving Imbalanced Data Classification

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

Over-sampling algorithm for imbalanced data classification

An Improving Majority Weighted Minority Oversampling Technique for Imbalanced Classification Problem

A Novel Adaptive Minority Oversampling Technique for Improved Classification in Data Imbalanced Scenarios

Weakly Supervised-Based Oversampling for High Imbalance and High Dimensionality Data Classification

An Over Sampling Method of Unbalanced Data Based on Ant Colony Clustering

SMOTE-WENN: Solving class imbalance and small sample problems by oversampling and distance scaling

Data oversampling and imbalanced datasets: an investigation of performance for machine learning and feature engineering

Optimizing Kernel Transformations to Handle Binary Class Imbalanced Dataset Classification

Synthetic Over-sampling with the Minority and Majority Classes for Imbalance Problems

Improved Oversampling Algorithm for Imbalanced Data Based on K-Nearest Neighbor and Interpolation Process Optimization

SP-SMOTE: A novel space partitioning based synthetic minority oversampling technique

A Synthetic Minority Oversampling Method Based on Local Densities in Low-Dimensional Space for Imbalanced Learning.