Abstract:Human activity recognition based on mobile device sensor data has been an active research area in mobile and pervasive computing for several years. While the majority of the proposed techniques are based on supervised learning, semi-supervised approaches are being considered to significantly reduce the size of the training set required to initialize the recognition model. These approaches usually apply self-training or active learning to incrementally refine the model, but their effectiveness seems to be limited to a restricted set of physical activities. We claim that the context which surrounds the user (e.g., semantic location, proximity to transportation routes, time of the day) combined with common knowledge about the relationship between this context and human activities could be effective in significantly increasing the set of recognized activities including those that are difficult to discriminate only considering inertial sensors, and the ones that are highly context-dependent. In this paper, we propose CAVIAR, a novel hybrid semi-supervised and knowledge-based system for real-time activity recognition. Our method applies semantic reasoning to context data to refine the prediction of a semi-supervised classifier. The context-refined predictions are used as new labeled samples to update the classifier combining self-training and active learning techniques. Results on a real dataset obtained from 26 subjects show the effectiveness of the context-aware approach both on the recognition rates and on the number of queries to the subjects generated by the active learning module. In order to evaluate the impact of context reasoning, we also compare CAVIAR with a purely statistical version, considering features computed on context data as part of the machine learning process.

Inference framework for activity recognition based on multiple semantic layers

Learning Visual Context for Group Activity Recognition.

Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion.

Bi-View Semi-Supervised Learning Based Semantic Human Activity Recognition Using Accelerometers.

Exploring Semantics in Activity Recognition Using Context Lattices.

Semantics-Driven Multi-user Concurrent Activity Recognition.

Improving activity recognition with context information

Context-Aware Human Activity Recognition in Industrial Processes

B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition.

A spatiotemporal multi-feature extraction framework with space and channel based squeeze-and-excitation blocks for human activity recognition

A Framework of Mining Semantic-Based Probabilistic Event Relations for Complex Activity Recognition.

Sensor-Based Human Activity Recognition in a Multi-user Scenario

Sensor-based Human Activity Recognition System with a Multilayered Model Using Time Series Shapelets

Discriminative Latent Models for Recognizing Contextual Group Activities

A Framework of Combining Short-Term Spatial/Frequency Feature Extraction and Long-Term IndRNN for Activity Recognition

Dynamic Inference via Localizing Semantic Intervals in Sensor Data for Budget-Tunable Activity Recognition

Unified Framework with Consistency across Modalities for Human Activity Recognition

A Multi-Task Deep Learning Approach for Sensor-based Human Activity Recognition and Segmentation

A Hierarchical Spatio-Temporal Model for Human Activity Recognition.

SemImput: Bridging Semantic Imputation with Deep Learning for Complex Human Activity Recognition

Context-driven Active and Incremental Activity Recognition