Abstract:Fine-grained video action recognition aims to identify minor and discriminative variations among fine categories of actions. While many recent action recognition methods have been proposed to better model spatio-temporal representations, how to model the interactions among discriminative atomic actions to effectively characterize inter-class and intra-class variations has been neglected, which is vital for understanding fine-grained actions. In this work, we devise a Discriminative Segment Focus Network (DSFNet) to mine the discriminability of segment correlations and localize discriminative action-relevant segments for fine-grained video action recognition. Firstly, we propose a hierarchic correlation reasoning (HCR) module which explicitly establishes correlations between different segments at multiple temporal scales and enhances each segment by exploiting the correlations with other segments. Secondly, a discriminative segment focus (DSF) module is devised to localize the most action-relevant segments from the enhanced representations of HCR by enforcing the consistency between the discriminability and the classification confidence of a given segment with a consistency constraint. Finally, these localized segment representations are combined with the global action representation of the whole video for boosting final recognition. Extensive experimental results on two fine-grained action recognition datasets, i.e. , FineGym and Diving48, and two action recognition datasets, i.e. , Kinetics400 and Something-Something, demonstrate the effectiveness of our approach compared with the state-of-the-art methods.

Discriminative-Element-Aware Sparse Representation for Action Recognition

Discovering Commonness and Specificness for Human Action Recognition.

Human Action Recognition Using Sparse Representation

Action Recognition Using Nonnegative Action Component Representation and Sparse Basis Selection

Learning a Discriminative Feature Descriptor with Sparse Coding for Action Recognition

Supervised class-specific dictionary learning for sparse modeling in action recognition

Discriminative Multi-View Subspace Feature Learning for Action Recognition

Sparse Coding on Local Spatial-Temporal Volumes for Human Action Recognition

Learning sparse representations for human action recognition

A Discriminative Representation for Human Action Recognition.

Combining RGB and Depth Features for Action Recognition Based on Sparse Representation.

Discriminative Segment Focus Network for Fine-grained Video Action Recognition

Action Recognition Using Direction-Dependent Feature Pairs and Non-Negative Low Rank Sparse Model

Compositional Models and Structured Learning for Visual Recognition

Action Recognition Using Low-Rank Sparse Representation

Learning Discriminative Activated Simplices for Action Recognition

Recurrent Temporal Sparse Autoencoder for Attention-Based Action Recognition.

Group Sparse-Based Mid-Level Representation for Action Recognition

A Non-negative Low Rank and Sparse Model for Action Recognition.

Action Recognition by Joint Learning

An improved method of action recognition based on sparse spatio-temporal features