Abstract:Human activity recognition (HAR) is one of the core research themes in ubiquitous and wearable computing. With the shift to deep learning (DL) based analysis approaches, it has become possible to extract high-level features and perform classification in an end-to-end manner. Despite their promising overall capabilities, DL-based HAR may suffer from overfitting due to the notoriously small, often inadequate, amounts of labeled sample data that are available for typical HAR applications. In response to such challenges, we propose ConvBoost -- a novel, three-layer, structured model architecture and boosting framework for convolutional network based HAR. Our framework generates additional training data from three different perspectives for improved HAR, aiming to alleviate the shortness of labeled training data in the field. Specifically, with the introduction of three conceptual layers--Sampling Layer, Data Augmentation Layer, and Resilient Layer -- we develop three "boosters" -- R-Frame, Mix-up, and C-Drop -- to enrich the per-epoch training data by dense-sampling, synthesizing, and simulating, respectively. These new conceptual layers and boosters, that are universally applicable for any kind of convolutional network, have been designed based on the characteristics of the sensor data and the concept of frame-wise HAR. In our experimental evaluation on three standard benchmarks (Opportunity, PAMAP2, GOTOV) we demonstrate the effectiveness of our ConvBoost framework for HAR applications based on variants of convolutional networks: vanilla CNN, ConvLSTM, and Attention Models. We achieved substantial performance gains for all of them, which suggests that the proposed approach is generic and can serve as a practical solution for boosting the performance of existing ConvNet-based HAR models. This is an open-source project, and the code can be found at <a class="link-external link-https" href="https://github.com/sshao2013/ConvBoost" rel="external noopener nofollow">this https URL</a>

Robust Human Activity Recognition Via Wearable Sensors Using Dynamic Gaussian Kernel Learning

A Sparse Diverse-Branch Large Kernel Convolutional Neural Network for Human Activity Recognition Using Wearables

Deep Neural Networks for Sensor-Based Human Activity Recognition Using Selective Kernel Convolution

Beyond Grids: Scaling Up Continuous Kernels Via Adaptive Point Representations for Sensor-Based Human Activity Recognition

Temporal-Spatial Dynamic Convolutional Neural Network for Human Activity Recognition Using Wearable Sensors

Deep Convolutional Networks With Tunable Speed–Accuracy Tradeoff for Human Activity Recognition Using Wearables

Human Activity Recognition Based on Gramian Angular Field and Deep Convolutional Neural Network

Human activity recognition using wearable sensors by heterogeneous convolutional neural networks

A lightweight neural network framework using linear grouped convolution for human activity recognition on mobile devices

Revisiting Large-Kernel CNN Design Via Structural Re-Parameterization for Sensor-Based Human Activity Recognition

Real-time Human Activity Recognition Using Conditionally Parametrized Convolutions on Mobile and Wearable Devices

An Efficient Diverse-Branch Convolution Scheme for Sensor-Based Human Activity Recognition

Shallow Convolutional Neural Networks for Human Activity Recognition Using Wearable Sensors

A Fast And Robust Deep Convolutional Neural Networks For Complex Human Activity Recognition Using Smartphone

Multiscale Deep Feature Learning for Human Activity Recognition Using Wearable Sensors

Short-Time Activity Recognition With Wearable Sensors Using Convolutional Neural Network

An Improved Deep Convolutional LSTM for Human Activity Recognition Using Wearable Sensors

A Multi-dimensional Parallel Convolutional Connected Network Based on Multi-source and Multi-modal Sensor Data for Human Activity Recognition

A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition

ConvBoost: Boosting ConvNets for Sensor-based Activity Recognition

Towards Better Accuracy-Efficiency Trade-Offs: Dynamic Activity Inference Via Collaborative Learning from Various Width-Resolution Configurations