Abstract:Action recognition is an enabling technology for many real world applications, such as human-computer interaction, surveillance, video retrieval, retirement home monitoring, and robotics. In the past decade, it has attracted a great amount of interest in the research community. Recently, the commoditization of depth sensors has generated much excitement in action recognition from depth sensors. New depth sensor technology has enabled many applications that were not feasible before. On one hand, action recognition becomes far easier with depth sensors. On the other hand, the drive to recognize more complex actions presents new challenges. One crucial aspect of action recognition is to extract discriminative features. The depth maps have completely different characteristics from the RGB images. Directly applying features designed for RGB images does not work. Complex actions usually involve complicated temporal structures, human-object interactions, and person-person contacts. New machine learning algorithms need to be developed to learn these complex structures. This work enables the reader to quickly familiarize themselves with the latest research in depth-sensor based action recognition, and to gain a deeper understanding of recently developed techniques. It will be of great use for both researchers and practitioners who are interested in human action recognition with depth sensors. The text focuses on feature representation and machine learning algorithms for action recognition from depth sensors. After presenting a comprehensive overview of the state of the art in action recognition from depth data, the authors then provide in-depth descriptions of their recently developed feature representations and machine learning techniques, including lower-level depth and skeleton features, higher-level representations to model the temporal structure and human-object interactions, and feature selection techniques for occlusion handling.

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Discriminative Hierarchical Part-Based Models for Human Parsing and Action Recognition.

Online Robust Action Recognition Based on a Hierarchical Model

Human Action Recognition Using Deep Learning Methods.

B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition.

Human-Object Interaction Recognition by Modeling Context

Action recognition in still images using a combination of human pose and context information

A Context Knowledge Map Guided Coarse-to-fine Action Recognition

A Novel Hierarchical Framework for Human Action Recognition

Human Action Recognition Based on Hierarchical Multi-Scale Adaptive Conv-Long Short-Term Memory Network

Human Action Recognition with Depth Cameras

Human motion recognition using three-dimensional skeleton model based on RGBD vision system

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Human Action Recognition Based on DMMs, HOGs and Contourlet Transform

An Approach to Pose-Based Action Recognition

Multi-View Region Adaptive Multi-temporal DMM and RGB Action Recognition

Context-Aware Cross-Attention for Skeleton-Based Human Action Recognition

Pose-conditioned Spatio-Temporal Attention for Human Action Recognition

Combining ConvNets with Hand-Crafted Features for Action Recognition Based on an HMM-SVM Classifier

Oriented Gradients for Human Action Recognition.

Typing Video frames after person detection Pose Tube 2 D Deconv Score fusion RGB action recognition Pose action recognition Pose estimation