Abstract:Human activity recognition (HAR) technology based on wearables has received increasing attention in recent years. The traditional methods have used hand-crafted features to recognize human activities, resulting in shallow feature extraction. With the development of deep learning, an increasing number of researchers have focused on studying deep learning methods. To achieve higher recognition accuracy, the majority of the current HAR research involves multisource and multimodal sensors (MMSs) data. However, due to the limitations in the receptive fields of single-dimensional convolutional kernels, these networks are still infeasible for extracting spatiotemporal features. In this study, a multidimensional parallel convolutional connected (MPCC) deep learning network based on MMS data for HAR is proposed that fully utilizes the advantages of multidimensional convolutional kernels. Moreover, multiscale residual convolutional squeeze-and-excitation (MRCSE) modules are proposed to enrich the diversity of feature information by combining squeeze-and-excitation (SE) blocks. A daily home activity (DHA) data set is constructed based on the requirements for HAR in certain scenarios, such as smart home, and we conduct experiments on the optimal combination of sensor locations on the DHA data set according to a weighted $\text{F}1~({\mathrm{ F}}_{\mathrm{ W}})$ -score. Both tenfold and leave-one-subject-out (LOSO) cross-validations (CVs) are used to evaluate the performance of the proposed network. The MPCC-MRCSE network achieves ${\mathrm{ F}}_{\mathrm{ W}}$ -scores of 98.33% and 95.42% on the physical activity monitoring for aging people (PAMAP2) and OPPORTUNITY data sets using tenfold CVs, respectively, and achieves ${\mathrm{ F}}_{\mathrm{ W}}$ -scores of 81.47% on the PAMAP2 when applying an LOSO CV.

Human Activity And Identitymulti-Task Recognition Based On Convolutional Neural Network Using Doppler Radar

Radar-based Multi-task Recognition Using Shrinkage Attention Mechanism

A Deep Multi-task Network for Activity Classification and Person Identification with Micro-Doppler Signatures

Human Activities Classification Based on Complex-Value Convolutional Neural Network

A Mutiscale Residual Attention Network for Multitask Learning of Human Activity Using Radar Micro-Doppler Signatures

Human Activity Recognition Based on Mixed CNN With Radar Multi-Spectrogram

Parallel LSTM-CNN Network with Radar Multispectrogram for Human Activity Recognition

Accurate Human Activity Recognition with Multi-Task Learning

A Multi-Task Deep Learning Approach for Sensor-based Human Activity Recognition and Segmentation

Convolutional Neural Network with Multi-Head Attention for Human Activity Recognition

Human Activity Recognition using A Improved Model Based on Multi-Head CNN-LSTM

A Multi-dimensional Parallel Convolutional Connected Network Based on Multi-source and Multi-modal Sensor Data for Human Activity Recognition

Cross-Attention Enhanced Pyramid Multi-Scale Networks for Sensor-based Human Activity Recognition

Residual Neural Network Driven Human Activity Recognition by Exploiting FMCW Radar

A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition

A multi-scale feature extraction fusion model for human activity recognition

Human Interaction Recognition Method Based on Parallel Multi-Feature Fusion Network

Deep Dilation on Multimodality Time Series for Human Activity Recognition.

Multihead-Res-SE Residual Network with Attention for Human Activity Recognition

Joint Motion Classification and Person Identification Via Multitask Learning for Smart Homes.

Multi-resolution Fusion Convolutional Network for Open Set Human Activity Recognition