Abstract:Human activity, which usually consists of several actions (sub-activities), generally covers interactions among persons and/or objects. In particular, human actions involve certain spatial and temporal relationships, are the components of more complicated activity, and evolve dynamically over time. Therefore, the description of a single human action and the modeling of the evolution of successive human actions are two major issues in human activity recognition. In this paper, we develop a method for human activity recognition that tackles these two issues. In the proposed method, an activity is divided into several successive actions represented by spatio-temporal patterns, and the evolution of these actions are captured by a sequential model. A refined comprehensive spatio-temporal graph is utilized to represent a single action, which is a qualitative representation of a human action incorporating both the spatial and temporal relations of the participant objects. Next, a discrete hidden Markov model is applied to model the evolution of action sequences. Moreover, a fully automatic partition method is proposed to divide a long-term human activity video into several human actions based on variational objects and qualitative spatial relations. Finally, a hierarchical decomposition of the human body is introduced to obtain a discriminative representation for a single action. Experimental results on the Cornell Activity Dataset demonstrate the efficiency and effectiveness of the proposed approach, which will enable long videos of human activity to be better recognized.

Hierarchical Activity Recognition Using Smart Watches and RGB-Depth Cameras.

Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion.

A Context-Aware Hierarchical Approach for Activity Recognition Based on Mobile Devices

Hierarchical Multi-View Aggregation Network for Sensor-Based Human Activity Recognition.

Hierarchical Decision Tree Model for Human Activity Recognition Using Wearable Sensors

Strong robustness human activity recognition based on wearable sensors

HierHAR: Sensor-Based Data-Driven Hierarchical Human Activity Recognition

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Human Activity Recognition Based on Wearable Sensor Using Hierarchical Deep LSTM Networks

A Model with Hierarchical Classifiers for Activity Recognition on Mobile Devices

Multi-User Activity Recognition In A Smart Home

A Human Activity Recognition Model Based on Wearable Sensor

Human Activity Recognition using Deep Learning Models on Smartphones and Smartwatches Sensor Data

An Adaptive Hidden Markov Model for Activity Recognition Based on a Wearable Multi-Sensor Device

Physical Activity Recognition Based on Motion in Images Acquired by a Wearable Camera

HHAR-net: Hierarchical Human Activity Recognition using Neural Networks

Sensor-based Human Activity Recognition System with a Multilayered Model Using Time Series Shapelets

Recognizing Multi-User Activities Using Wearable Sensors in a Smart Home

Learning Dynamic Spatio-Temporal Relations for Human Activity Recognition.

RGBD-HuDaAct: A color-depth video database for human daily activity recognition

A Hierarchical Approach to Real-Time Activity Recognition in Body Sensor Networks