Abstract:Recognizing human actions in untrimmed videos is an important challenging task. An effective 3D motion representation and a powerful learning model are two key factors influencing recognition performance. In this paper we introduce a new skeleton-based representation for 3D action recognition in videos. The key idea of the proposed representation is to transform 3D joint coordinates of the human body carried in skeleton sequences into RGB images via a color encoding process. By normalizing the 3D joint coordinates and dividing each skeleton frame into five parts, where the joints are concatenated according to the order of their physical connections, the color-coded representation is able to represent spatio-temporal evolutions of complex 3D motions, independently of the length of each sequence. We then design and train different Deep Convolutional Neural Networks (D-CNNs) based on the Residual Network architecture (ResNet) on the obtained image-based representations to learn 3D motion features and classify them into classes. Our method is evaluated on two widely used action recognition benchmarks: MSR Action3D and NTU-RGB+D, a very large-scale dataset for 3D human action recognition. The experimental results demonstrate that the proposed method outperforms previous state-of-the-art approaches whilst requiring less computation for training and prediction.

3D Action Recognition Using Multi-Temporal Skeleton Visualization.

3D Action Recognition Using Data Visualization and Convolutional Neural Networks.

Action Recognition Based on 3D Skeleton and RGB Frame Fusion

Skeleton-based Human Action Recognition by Fusing Attention Based Three-Stream Convolutional Neural Network and SVM.

Joints-Centered Spatial-Temporal Features Fused Skeleton Convolution Network for Action Recognition

Skeleton-Based Human Action Recognition Using Spatial Temporal 3D Convolutional Neural Networks

3d Human Action Recognition Based On The Spatial-Temporal Moving Skeleton Descriptor

Multisource Learning for Skeleton-Based Action Recognition Using Deep LSTM and CNN

A New Representation of Skeleton Sequences for 3D Action Recognition

Temporal Cues Enhanced Multimodal Learning for Action Recognition in RGB-D Videos

Skeleton-based Action Recognition Using LSTM and CNN

3D Skeleton Based Action Recognition by Video-Domain Translation-Scale Invariant Mapping and Multi-Scale Dilated CNN

Multi-source Learning for Skeleton -Based Action Recognition Using Deep LSTM Networks

Enhanced Skeleton Visualization for View Invariant Human Action Recognition.

Two-Stream 3D Convolutional Neural Network for Skeleton-Based Action Recognition

Deep Learning‐based Action Recognition with 3D Skeleton: A Survey

3D Action Recognition Using Multi-Temporal Depth Motion Maps and Fisher Vector

Learning to Recognize 3D Human Action from A New Skeleton-based Representation Using Deep Convolutional Neural Networks

Skeleton-Indexed Deep Multi-Modal Feature Learning for High Performance Human Action Recognition

Multiple temporal scale aggregation graph convolutional network for skeleton-based action recognition

Accurate And Real-Time Human Action Recognition Based On 3d Skeleton