Abstract:Abstract Human activity recognition (HAR) using inertial motion data has gained a lot of momentum in recent years both in research and industrial applications. From the abstract perspective, this has been driven by the rapid dynamics for building intelligent, smart environments, and ubiquitous systems that cover all aspects of human life including healthcare, sports, manufacturing, commerce, etc., which necessitate and subsume activity recognition aiming at recognizing the actions, characteristics, and goals of one or more agent(s) from a temporal series of observations streamed from one or more sensors. From a more concrete and seemingly orthogonal perspective, such momentum has been driven by the ubiquity of inertial motion sensors on-board mobile and wearable devices including smartphones, smartwatches, etc. In this paper we give an introductory and a comprehensive survey to the subject from a given perspective. We focus on a subset of topics, that we think are major, that will have significant and influential impacts on the future research and industrial-scale deployment of HAR systems. These include: (1) a comprehensive and detailed description of the inertial motion benchmark datasets that are publicly available and/or accessible, (2) feature selection and extraction techniques and the corresponding learning methods used to build workable HAR systems; we survey classical handcrafted datasets as well as data-oriented automatic representation learning approach to the subject, (3) transfer learning as a way to overcome many hurdles in actual deployments of HAR systems on a large scale, (4) embedded implementations of HAR systems on mobile and/or wearable devices, and finally (5) we touch on adversarial attacks, a topic that is essentially related to the security and privacy of HAR systems. As the field is very huge and diverse, this article is by no means comprehensive; it is though meant to provide a logically and conceptually rather complete picture to advanced practitioners, as well as to present a readable guided introduction to newcomers. Our logical and conceptual perspectives mimic the typical data science pipeline for state-of-the-art AI-based systems.

A Graph-based Approach to Human Activity Recognition

Using Graphs to Perform Effective Sensor-Based Human Activity Recognition in Smart Homes

Computational Graph Approach for Detection of Composite Human Activities

Know Thy Neighbors: A Graph Based Approach for Effective Sensor-Based Human Activity Recognition in Smart Homes

Decoding Human Activities: Analyzing Wearable Accelerometer and Gyroscope Data for Activity Recognition

Automatic Identification and Visualization of Group Training Activities Using Wearable Data

Beyond the Gates of Euclidean Space: Temporal-Discrimination-Fusions and Attention-based Graph Neural Network for Human Activity Recognition

A new approach for physical human activity recognition based on co-occurrence matrices

Improving Human Activity Recognition for Sparse Radar Point Clouds: A Graph Neural Network Model with Pre-Trained 3D Human-Joint Coordinates

Detection and Validation of Macro-Activities in Human Inertial Signals Using Graph Link Prediction

Graph-based Sparse Coding and Embedding for Activity-Based Human Identification

Multimodal Human Activity Recognition From Wearable Inertial Sensors Using Machine Learning

Sensor-based Human Activity Recognition System with a Multilayered Model Using Time Series Shapelets

Human Activity Recognition Based on Wireless Electrocardiogram and Inertial Sensors

A perspective on human activity recognition from inertial motion data

Human activity recognition using visibility graph features coupled with machine learning algorithm

Leveraging spatio-temporal features using graph neural networks for human activity recognition

Recognizing Activities and Spatial Context Using Wearable Sensors

Human Activity Recognition using Wearable Sensors: Review, Challenges, Evaluation Benchmark

A Novel Deep Learning Bi-GRU-I Model for Real-Time Human Activity Recognition Using Inertial Sensors

Automatic Sensor-Based Detection and Classification of Climbing Activities