Deep Learning for Heterogeneous Human Activity Recognition in Complex IoT Applications

Mohamed Abdel-Basset,Hossam Hawash,Victor Chang,Ripon K. Chakrabortty,Michael Ryan
DOI: https://doi.org/10.1109/jiot.2020.3038416
IF: 10.6
2022-04-15
IEEE Internet of Things Journal
Abstract:With continued improvements in wireless sensing technology, the notion of the Internet of Things (IoT) has been widely adopted and has become pervasive owing to its broad applications in scenarios such as ambient assisted living, smart healthcare, and smart homes. In that regard, Human Activity Recognition (HAR) is a vital element of intelligent systems to undertake persistent surveillance of human behavior. Due to the omnipresent impact of smartphones in each person's life, smartphone inertial sensors are used as a case study for this research. Most of the conventional approaches regard HAR as a time series classification problem; yet, the accuracy of recognition degrades for heterogeneous sensors. In this paper, we investigate encoding sensory heterogeneous HAR (HHAR) data into three-channel image representation (i.e. RGB), hence treat the HHAR task as an image classification problem. Since present convolutional network models are computationally heavy when deployed in the IoT environment, we propose a lightweight model image encoded HHAR, calledmulti-scale image encoded HHAR (MS-IE-HHAR). The model employs a Hierarchical Multi-scale Extraction (HME) module followed by an Improved Spatial-wise and Channel-wise Attention (ISCA) module to form the main architecture of the model. The HME module is formed by a group of residually connected shuffle group convolutions (SG-Conv) to extract and learn image representations from different receptive fields while reducing the number of network parameters. The ISCA module combines a lightweight spatial-wise attention (SwA) block and an improved channel-wise attention (CwA) module to enable the network to pay instructive attention to spatial correlations as well as channel interdependency information. Finally, two widely available HHAR public datasets (i.e. HHAR UCI, and MHEALTH) were used to evaluate the performance of the proposed models with accuracy over 98% and 99%, respectively, demonstrati-g the model superiority for modeling HAR from heterogeneous data sources.
computer science, information systems,telecommunications,engineering, electrical & electronic
What problem does this paper attempt to address?