Comparative Analysis of XGBoost and Minirocket Algortihms for Human Activity Recognition

Celal Alagoz

2024-02-28

Abstract:Human Activity Recognition (HAR) has been extensively studied, with recent emphasis on the implementation of advanced Machine Learning (ML) and Deep Learning (DL) algorithms for accurate classification. This study investigates the efficacy of two ML algorithms, eXtreme Gradient Boosting (XGBoost) and MiniRocket, in the realm of HAR using data collected from smartphone sensors. The experiments are conducted on a dataset obtained from the UCI repository, comprising accelerometer and gyroscope signals captured from 30 volunteers performing various activities while wearing a smartphone. The dataset undergoes preprocessing, including noise filtering and feature extraction, before being utilized for training and testing the classifiers. Monte Carlo cross-validation is employed to evaluate the models' robustness. The findings reveal that both XGBoost and MiniRocket attain accuracy, F1 score, and AUC values as high as 0.99 in activity classification. XGBoost exhibits a slightly superior performance compared to MiniRocket. Notably, both algorithms surpass the performance of other ML and DL algorithms reported in the literature for HAR tasks. Additionally, the study compares the computational efficiency of the two algorithms, revealing XGBoost's advantage in terms of training time. Furthermore, the performance of MiniRocket, which achieves accuracy and F1 values of 0.94, and an AUC value of 0.96 using raw data and utilizing only one channel from the sensors, highlights the potential of directly leveraging unprocessed signals. It also suggests potential advantages that could be gained by utilizing sensor fusion or channel fusion techniques. Overall, this research sheds light on the effectiveness and computational characteristics of XGBoost and MiniRocket in HAR tasks, providing insights for future studies in activity recognition using smartphone sensor data.

Machine Learning

What problem does this paper attempt to address?

The paper aims to address the problem of Human Activity Recognition (HAR), specifically by recognizing various human activities through smartphone sensor data. The study compares the performance of two machine learning algorithms—Extreme Gradient Boosting (XGBoost) and MiniRocket—in the HAR task.

The main objectives of the paper include:
1. **Evaluate Algorithm Effectiveness**: Assess the performance of XGBoost and MiniRocket in the human activity recognition task, particularly in terms of accuracy, F1 score, and Area Under the Curve (AUC).
2. **Compare Computational Efficiency**: Contrast the differences in computational efficiency between the two algorithms, especially in terms of training time.
3. **Explore the Possibility of Using Raw Signals Directly**: Evaluate the performance of MiniRocket when processing raw, unprocessed sensor data and explore its potential advantages.
4. **Surpass Existing Algorithms**: Demonstrate the superiority of these two algorithms over other existing machine learning and deep learning algorithms in the HAR task.

Through these objectives, the paper hopes to provide valuable insights and guidance for future research on human activity recognition based on smartphone sensor data.