Advanced Payment Security System:XGBoost, LightGBM and SMOTE Integrated

Qi Zheng,Chang Yu,Jin Cao,Yongshun Xu,Qianwen Xing,Yinxin Jin

2024-07-26

Abstract:With the rise of various online and mobile payment systems, transaction fraud has become a significant threat to financial security. This study explores the application of advanced machine learning models, specifically based on XGBoost and LightGBM, for developing a more accurate and robust Payment Security Protection Model. To enhance data reliability, we meticulously processed the data sources and applied SMOTE (Synthetic Minority Over-sampling Technique) to address class imbalance and improve data representation. By selecting highly correlated features, we aimed to strengthen the training process and boost model performance. We conducted thorough performance evaluations of our proposed models, comparing them against traditional methods including Random Forest, Neural Network, and Logistic Regression. Using metrics such as Precision, Recall, and F1 Score, we rigorously assessed their effectiveness. Our detailed analyses and comparisons reveal that the combination of SMOTE with XGBoost and LightGBM offers a highly efficient and powerful mechanism for payment security protection. Moreover, the integration of XGBoost and LightGBM in a Local Ensemble model further demonstrated outstanding performance. After incorporating SMOTE, the new combined model achieved a significant improvement of nearly 6\% over traditional models and around 5\% over its sub-models, showcasing remarkable results.

Cryptography and Security,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper attempts to address the issue of transaction fraud in online payment systems. With the rise of various online and mobile payment systems, transaction fraud has become a significant threat to financial security. This paper aims to develop a more accurate and robust payment security protection model by applying advanced machine learning models, particularly those based on XGBoost and LightGBM. To improve data reliability, the researchers carefully processed the data sources and used SMOTE (Synthetic Minority Over-sampling Technique) to address the class imbalance problem, thereby improving data representation. By selecting highly relevant features, the researchers aim to enhance the training process and improve model performance.

Specifically, the goals of the paper include:
1. **Improving the accuracy of the payment security protection model**: By using advanced machine learning models such as XGBoost and LightGBM, the detection accuracy of fraudulent transactions is improved.
2. **Addressing the class imbalance problem**: Using SMOTE to generate synthetic samples, balancing the majority and minority classes in the dataset, thereby improving the model's performance on the minority class.
3. **Optimizing feature selection**: Selecting features that are highly relevant to the target variable to enhance the training effect of the model.
4. **Evaluating model performance**: Comprehensive evaluation of the proposed model's performance using metrics such as Precision, Recall, and F1 Score, and comparing it with traditional methods such as Random Forest, Neural Networks, and Logistic Regression.
5. **Building an ensemble model**: Combining the advantages of XGBoost and LightGBM to construct a local ensemble model and further optimize its performance.

Through these methods, the paper aims to provide an efficient and robust solution for payment security protection, significantly improving the performance of existing models.