Abstract:Human activity recognition (HAR) technology based on wearables has received increasing attention in recent years. The traditional methods have used hand-crafted features to recognize human activities, resulting in shallow feature extraction. With the development of deep learning, an increasing number of researchers have focused on studying deep learning methods. To achieve higher recognition accuracy, the majority of the current HAR research involves multisource and multimodal sensors (MMSs) data. However, due to the limitations in the receptive fields of single-dimensional convolutional kernels, these networks are still infeasible for extracting spatiotemporal features. In this study, a multidimensional parallel convolutional connected (MPCC) deep learning network based on MMS data for HAR is proposed that fully utilizes the advantages of multidimensional convolutional kernels. Moreover, multiscale residual convolutional squeeze-and-excitation (MRCSE) modules are proposed to enrich the diversity of feature information by combining squeeze-and-excitation (SE) blocks. A daily home activity (DHA) data set is constructed based on the requirements for HAR in certain scenarios, such as smart home, and we conduct experiments on the optimal combination of sensor locations on the DHA data set according to a weighted $\text{F}1~({\mathrm{ F}}_{\mathrm{ W}})$ -score. Both tenfold and leave-one-subject-out (LOSO) cross-validations (CVs) are used to evaluate the performance of the proposed network. The MPCC-MRCSE network achieves ${\mathrm{ F}}_{\mathrm{ W}}$ -scores of 98.33% and 95.42% on the physical activity monitoring for aging people (PAMAP2) and OPPORTUNITY data sets using tenfold CVs, respectively, and achieves ${\mathrm{ F}}_{\mathrm{ W}}$ -scores of 81.47% on the PAMAP2 when applying an LOSO CV.

Hybrid Fuzzy C-Means CPD-Based Segmentation for Improving Sensor-Based Multiresident Activity Recognition

Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion.

Privacy-preserving Activity Recognition Using Multimodal Sensors in Smart Office

Dynamic Segmentation of Sensor Events for Real-Time Human Activity Recognition in a Smart Home Context

A Multi-Task Deep Learning Approach for Sensor-based Human Activity Recognition and Segmentation

KCAR: A knowledge-driven approach for concurrent activity recognition

Multi-User Activity Recognition In A Smart Home

A Multi-dimensional Parallel Convolutional Connected Network Based on Multi-source and Multi-modal Sensor Data for Human Activity Recognition

A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition

Generative Resident Separation and Multi-label Classification for Multi-person Activity Recognition

A Boundary Consistency-aware Multi-task Learning Framework for Joint Activity Segmentation and Recognition with Wearable Sensors

PALMAR: Towards Adaptive Multi-inhabitant Activity Recognition in Point-Cloud Technology

Recognizing Multi-User Activities Using Wearable Sensors in a Smart Home

A spatiotemporal multi-feature extraction framework with space and channel based squeeze-and-excitation blocks for human activity recognition

A Survey on Multi-Resident Activity Recognition in Smart Environments

An Unsupervised Approach to Activity Recognition and Segmentation Based on Object-Use Fingerprints

Multimodal Fusion-AdaBoost Based Activity Recognition for Smart Home on WiFi Platform

Multi-Sensor Data Fusion and CNN-LSTM Model for Human Activity Recognition System

Position-Aware Indoor Human Activity Recognition Using Multisensors Embedded in Smartphones

Sensor-Based Human Activity Recognition in a Multi-user Scenario

Adaptive Multimodal Fusion Framework for Activity Monitoring of People with Mobility Disability