Abstract:With continued improvements in wireless sensing technology, the notion of the Internet of Things (IoT) has been widely adopted and has become pervasive owing to its broad applications in scenarios such as ambient assisted living, smart healthcare, and smart homes. In that regard, Human Activity Recognition (HAR) is a vital element of intelligent systems to undertake persistent surveillance of human behavior. Due to the omnipresent impact of smartphones in each person's life, smartphone inertial sensors are used as a case study for this research. Most of the conventional approaches regard HAR as a time series classification problem; yet, the accuracy of recognition degrades for heterogeneous sensors. In this paper, we investigate encoding sensory heterogeneous HAR (HHAR) data into three-channel image representation (i.e. RGB), hence treat the HHAR task as an image classification problem. Since present convolutional network models are computationally heavy when deployed in the IoT environment, we propose a lightweight model image encoded HHAR, calledmulti-scale image encoded HHAR (MS-IE-HHAR). The model employs a Hierarchical Multi-scale Extraction (HME) module followed by an Improved Spatial-wise and Channel-wise Attention (ISCA) module to form the main architecture of the model. The HME module is formed by a group of residually connected shuffle group convolutions (SG-Conv) to extract and learn image representations from different receptive fields while reducing the number of network parameters. The ISCA module combines a lightweight spatial-wise attention (SwA) block and an improved channel-wise attention (CwA) module to enable the network to pay instructive attention to spatial correlations as well as channel interdependency information. Finally, two widely available HHAR public datasets (i.e. HHAR UCI, and MHEALTH) were used to evaluate the performance of the proposed models with accuracy over 98% and 99%, respectively, demonstrati-g the model superiority for modeling HAR from heterogeneous data sources.

Hybrid Deep Model for Human Behavior Understanding on Industrial Internet of Video Things

Deep Learning for Industrial Image: Challenges, Methods for Enriching the Sample Space and Restricting the Hypothesis Space, and Possible Issue

Human-Machine Learning for Data-Driven Scenarios

Human behaviour recognition and monitoring based on deep convolutional neural networks

Digital Twin for Human-Machine Interaction with Convolutional Neural Network.

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Human Action Recognition From Digital Videos Based on Deep Learning.

Human Behaviour Recognition Using Deep Learning

Human Behavior Recognition from Multiview Videos

Hybrid machine learning for human action recognition and prediction in assembly

Exploring a Humanoid Video-Understanding Algorithm Guided by Behavior.

Hybrid Recurrent Neural Network Architecture-Based Intention Recognition for Human-Robot Collaboration

3D Convolutional Neural Network for Human Behavior Analysis in Intelligent Sensor Network

A Canonical Polyadic Deep Convolutional Computation Model for Big Data Feature Learning in Internet of Things

Efficient Data-Driven Behavior Identification Based on Vision Transformers for Human Activity Understanding

Human risk recognition and prediction in manned submersible diving tasks driven by deep learning models

Cross-View Human Intention Recognition for Human-Robot Collaboration

A Tensor-Train Deep Computation Model for Industry Informatics Big Data Feature Learning

Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification

Deep Learning for Heterogeneous Human Activity Recognition in Complex IoT Applications

Joint Motion Information Extraction and Human Behavior Recognition in Video Based on Deep Learning