Abstract:Data representation learning is one of the most important problems in machine learning. Unsupervised representation learning becomes meritorious as it has no necessity of label information with observed data. Due to the highly time-consuming learning of deep-learning models, there are many machine-learning models directly adapting well-trained deep models that are obtained in a supervised and end-to-end manner as feature abstractors to distinct problems. However, it is obvious that different machine-learning tasks require disparate representation of original input data. Taking human action recognition as an example, it is well known that human actions in a video sequence are 3-D signals containing both visual appearance and motion dynamics of humans and objects. Therefore, the data representation approaches with the capabilities to capture both spatial and temporal correlations in videos are meaningful. Most of the existing human motion recognition models build classifiers based on deep-learning structures such as deep convolutional networks. These models require a large quantity of training videos with annotations. Meanwhile, these supervised models cannot recognize samples from the distinct dataset without retraining. In this article, we propose a new 3-D deconvolutional network (3DDN) for representation learning of high-dimensional video data, in which the high-level features are obtained through the optimization approach. The proposed 3DDN decomposes the video frames into spatiotemporal features under a sparse constraint in an unsupervised way. In addition, it also can be regarded as a building block to develop deep architectures by stacking. The high-level representation of input sequential data can be used in multiple downstream machine-learning tasks, we evaluate the proposed 3DDN and its deep models in human action recognition. The experimental results from three datasets: 1) KTH data; 2) HMDB-51; and 3) UCF-101, demonstrate that the-proposed 3DDN is an alternative approach to feedforward convolutional neural networks (CNNs), that attains comparable results.

Action Recognition with Motion Map 3D Network

Deep Convolutional Neural Networks for Action Recognition Using Depth Map Sequences

DC3D: A Video Action Recognition Network Based on Dense Connection

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Spatiotemporal Multimodal Learning With 3D CNNs for Video Action Recognition

The Multidimensional Motion Features of Spatial Depth Feature Maps: An Effective Motion Information Representation Method for Video-Based Action Recognition

Action Recognition from Depth Maps Using Deep Convolutional Neural Networks

Long-term 3D Convolutional Fusion Network for Action Recognition

T-C3D: Temporal Convolutional 3D Network for Real-Time Action Recognition

3D-Cnn-based Fused Feature Maps with LSTM Applied to Action Recognition.

Action recognition method based on a novel keyframe extraction method and enhanced 3D convolutional neural network

Multi-stream with Deep Convolutional Neural Networks for Human Action Recognition in Videos

Multi‐mode Neural Network for Human Action Recognition

Action Recognition By Learning Deep Multi-Granular Spatio-Temporal Video Representation

3-D Deconvolutional Networks for the Unsupervised Representation Learning of Human Motions

3D Residual Networks with Channel-Spatial Attention Module for Action Recognition

A Spatio-temporal Hybrid Network for Action Recognition

Multi-modality Fusion Network for Action Recognition.

ARCH: Adaptive Recurrent-Convolutional Hybrid Networks for Long-Term Action Recognition

MiCT: Mixed 3D/2D Convolutional Tube for Human Action Recognition

I3D-LSTM: A New Model for Human Action Recognition