Abstract:Human actions recognition is a fundamental task in artificial vision, that has earned a great importance in recent years due to its multiple applications in different areas. %, such as the study of human behavior, security or video surveillance. In this context, this paper describes an approach for real-time human action recognition from raw depth image-sequences, provided by an RGB-D camera. The proposal is based on a 3D fully convolutional neural network, named 3DFCNN, which automatically encodes spatio-temporal patterns from depth sequences without %any costly pre-processing. Furthermore, the described 3D-CNN allows %automatic features extraction and actions classification from the spatial and temporal encoded information of depth sequences. The use of depth data ensures that action recognition is carried out protecting people's privacy% allows recognizing the actions carried out by people, protecting their privacy%\sout{of them} , since their identities can not be recognized from these data. %\st{ from depth images.} 3DFCNN has been evaluated and its results compared to those from other state-of-the-art methods within three widely used %large-scale NTU RGB+D datasets, with different characteristics (resolution, sensor type, number of views, camera location, etc.). The obtained results allows validating the proposal, concluding that it outperforms several state-of-the-art approaches based on classical computer vision techniques. Furthermore, it achieves action recognition accuracy comparable to deep learning based state-of-the-art methods with a lower computational cost, which allows its use in real-time applications.

Continuous Motion Recognition In Depth Camera Based On Recurrent Neural Networks And Grid-Based Average Depth

How Deep Neural Networks Understand Motion? Toward Interpretable Motion Modeling by Leveraging the Relative Change in Position

Recurrent Neural Network for Learning DenseDepth and Ego-Motion from Video

Deep Convolutional Neural Networks for Action Recognition Using Depth Map Sequences

Region Deformer Networks for Unsupervised Depth Estimation from Unconstrained Monocular Videos

Online Robust Action Recognition Based on a Hierarchical Model

DMM-Pyramid Based Deep Architectures for Action Recognition with Depth Cameras

Skeleton-Based Square Grid for Human Action Recognition With 3D Convolutional Neural Network

Skeleton-Based Human Action Recognition Using Spatial Temporal 3D Convolutional Neural Networks

3DFCNN: Real-Time Action Recognition using 3D Deep Neural Networks with Raw Depth Information

Skeleton-based Action Recognition Using LSTM and CNN

Hierarchical recurrent neural network for skeleton based action recognition

Action Recognition for Depth Video using Multi-view Dynamic Images

Deep learning-based multi-view 3D-human action recognition using skeleton and depth data

Real-Time Human Action Recognition System Using Depth Map Sequences

Motionrfcn: Motion Segmentation Using Consecutive Dense Depth Maps

View Adaptive Recurrent Neural Networks for High Performance Human Action Recognition from Skeleton Data

Human Skeleton Tree Recurrent Neural Network with Joint Relative Motion Feature for Skeleton Based Action Recognition

Deep Tracking on the Move: Learning to Track the World from a Moving Vehicle using Recurrent Neural Networks

Deep RNN Framework for Visual Sequential Applications

Human motion recognition information processing system based on LSTM Recurrent Neural Network Algorithm