Abstract:Human activity recognition (HAR) technology based on wearables has received increasing attention in recent years. The traditional methods have used hand-crafted features to recognize human activities, resulting in shallow feature extraction. With the development of deep learning, an increasing number of researchers have focused on studying deep learning methods. To achieve higher recognition accuracy, the majority of the current HAR research involves multisource and multimodal sensors (MMSs) data. However, due to the limitations in the receptive fields of single-dimensional convolutional kernels, these networks are still infeasible for extracting spatiotemporal features. In this study, a multidimensional parallel convolutional connected (MPCC) deep learning network based on MMS data for HAR is proposed that fully utilizes the advantages of multidimensional convolutional kernels. Moreover, multiscale residual convolutional squeeze-and-excitation (MRCSE) modules are proposed to enrich the diversity of feature information by combining squeeze-and-excitation (SE) blocks. A daily home activity (DHA) data set is constructed based on the requirements for HAR in certain scenarios, such as smart home, and we conduct experiments on the optimal combination of sensor locations on the DHA data set according to a weighted $\text{F}1~({\mathrm{ F}}_{\mathrm{ W}})$ -score. Both tenfold and leave-one-subject-out (LOSO) cross-validations (CVs) are used to evaluate the performance of the proposed network. The MPCC-MRCSE network achieves ${\mathrm{ F}}_{\mathrm{ W}}$ -scores of 98.33% and 95.42% on the physical activity monitoring for aging people (PAMAP2) and OPPORTUNITY data sets using tenfold CVs, respectively, and achieves ${\mathrm{ F}}_{\mathrm{ W}}$ -scores of 81.47% on the PAMAP2 when applying an LOSO CV.

Dense Sensing-Based Composite Activity Recognition in Smart Home

Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion.

Semantics-Driven Multi-user Concurrent Activity Recognition.

KCAR: A knowledge-driven approach for concurrent activity recognition

Mining Intricate Temporal Rules for Recognizing Complex Activities of Daily Living under Uncertainty.

A hybrid approach to inferring the Internet of Things for complex activity recognition

Multi-User Activity Recognition In A Smart Home

Concurrent Activity Recognition with Multimodal CNN-LSTM Structure

Action2Activity: Recognizing Complex Activities from Sensor Data.

Exploring Semantics in Activity Recognition Using Context Lattices.

A Graph-Attention-Based Method for Single-Resident Daily Activity Recognition in Smart Homes.

A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition

Latent-Dynamic Conditional Random Fields for recognizing activities in smart homes

A Multi-dimensional Parallel Convolutional Connected Network Based on Multi-source and Multi-modal Sensor Data for Human Activity Recognition

A Knowledge-Driven Approach to Activity Recognition in Smart Homes

An event-based approach to multi-modal activity modeling and recognition

Multimodal Monitoring of Activities of Daily Living for Elderly Care

CASL: Capturing Activity Semantics Through Location Information for Enhanced Activity Recognition

Complex Activity Recognition Using Time Series Pattern Dictionary Learned from Ubiquitous Sensors

Activity Recognition Approach Based on Spatial-Temporal Constraints for Aged-Care in Smart Home.

Sensor-based Human Activity Recognition System with a Multilayered Model Using Time Series Shapelets