Abstract:Recently, human activity recognition using skeleton data is increasing due to its ease of acquisition and finer shape details. Still, it suffers from a wide range of intra-class variation, inter-class similarity among the actions and view variation due to which extraction of discriminative spatial and temporal features is still a challenging problem. In this regard, we present a novel Residual Inception Attention Driven CNN (RIAC-Net) Network, which visualizes the dynamics of the action in a part-wise manner. The complete skeletonis partitioned into five key parts: Head to Spine, Left Leg, Right Leg, Left Hand, Right Hand. For each part, a Compact Action Skeleton Sequence (CASS) is defined. Part-wise skeleton-based motion dynamics highlights discriminative local features of the skeleton that helps to overcome the challenges of inter-class similarity and intra-class variation with improved recognition performance. The RIAC-Net architecture is inspired by the concept of inception-residual representation that unifies the Attention Driven Residues (ADR) with inception-based Spatio-Temporal Convolution Features (STCF) to learn efficient salient action features. An ablation study is also carried out to analyze the effect of ADR over simple residue-based action representation. The robustness of the proposed framework is evaluated by performing an extensive experiment on four challenging datasets: UT Kinect Action 3D, Florence 3D action, MSR Daily Action3D, and NTU RGB-D datasets, which consistently demonstrate the superiority of the proposed method over other state-of-the-art methods.

A Novel 3D Human Action Recognition Framework for Video Content Analysis.

Deep spatiotemporal LSTM network with temporal pattern feature for 3D human action recognition

Human Action Recognition Using Deep Learning Methods.

3d Human Action Recognition With Skeleton Orientation Vectors And Stacked Residual Bi-Lstm

A Novel Hierarchical Framework for Human Action Recognition

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Learning to Recognize 3D Human Action from A New Skeleton-based Representation Using Deep Convolutional Neural Networks

Skeleton-based Action Recognition Using LSTM and CNN

3D Action Recognition Using Multi-Temporal Skeleton Visualization.

Action Status Based Novel Relative Feature Representations for Interaction Recognition

Spatio-Temporal Attention-Based LSTM Networks for 3D Action Recognition and Detection

I3D-LSTM: A New Model for Human Action Recognition

Human Action Recognition Based on Kinematic Similarity in Real Time.

Skeleton-based Human Action Recognition by Fusing Attention Based Three-Stream Convolutional Neural Network and SVM.

A Fine-to-Coarse Convolutional Neural Network for 3D Human Action Recognition

Real-Time Human Action Recognition Using Locally Aggregated Kinematic-Guided Skeletonlet and Supervised Hashing-by-Analysis Model.

Part-wise Spatio-temporal Attention Driven CNN-based 3D Human Action Recognition

Skeleton-Based Human Action Recognition Using Spatial Temporal 3D Convolutional Neural Networks

3DV: 3D Dynamic Voxel for Action Recognition in Depth Video

3D Action Recognition Using Data Visualization and Convolutional Neural Networks.

Bi-direction Hierarchical LSTM with Spatial-Temporal Attention for Action Recognition