Abstract:Learning by deep convolutional networks have shown an outstanding effectiveness in a variety of vision based classification tasks, and for which, large datasets are the prerequisites to guarantee its high performance. But in many realistic circumstances, using a massive quantity of training samples to achieve more sophisticated analysis is hard to be fulfilled always, such as human action recognition in videos, and the resulting problem of data deficiency, especially for the labeled data, would critically limit the deeper model structure as a promising solution due to its high risk of overfitting. Additionally, in lacking of high modeling capacity constrained by of model depth, the high-level visual cues like object interaction, scene context and pose variations concurrent with human action also could become the extrinsic and intrinsic challenges for the traditional deep convolutional networks. For the limitations above, in this paper, we proposed a strategy of dataset remodeling by transferring parameters of ResNet-101 layers trained on the ImageNet dataset to initialize learning model and adopt an augmented data variation approach to overcome the overfitting challenge of sample deficiency. For model structure improvement, a novel deeper two-stream ConvNets has been designed for the learning of action complexity. With a dis-order strategy of training/testing video sets, the proposed model and learning strategy are able to collaboratively achieve a significant improvement of action recognition. Experiments on two challenging datasets UCF101 and KTH have verified a superior performance in comparison with other state-of-the-art methods. (C) 2017 Published by Elsevier B.V.

Two-Stream Gated Fusion ConvNets for Action Recognition

Learning Gating ConvNet for Two-Stream based Methods in Action Recognition.

Convolutional Gated Recurrent Units Fusion For Video Action Recognition

Two-Stream 3-D Convnet Fusion for Action Recognition in Videos with Arbitrary Size and Length

Residual Gating Fusion Network for Human Action Recognition.

3D Convolutional Two-Stream Network for Action Recognition in Videos

Multi-scale Spatiotemporal Information Fusion Network for Video Action Recognition

Fully Convolutional Networks for Action Recognition

Multi-head attention-based two-stream EfficientNet for action recognition

GCF-Net: Gated Clip Fusion Network for Video Action Recognition

Towards Good Practices for Very Deep Two-Stream ConvNets.

Temporal Interaction and Excitation for Action Recognition

Multi-dimension Feature Fusion for Action Recognition

Action Recognition in Videos with Temporal Segments Fusions

Efficient dual attention SlowFast networks for video action recognition

Multi-modality Fusion Network for Action Recognition.

Two-stream graph convolutional neural network fusion for weakly supervised temporal action detection

Deep Spatiotemporal Relation Learning with 3D Multi-Level Dense Fusion for Video Action Recognition

3-Stream Convolutional Networks for Video Action Recognition with Hybrid Motion Field

A simulated two-stream network via multilevel distillation of reviewed features and decoupled logits for video action recognition

Going Deeper with Two-Stream ConvNets for Action Recognition in Video Surveillance