Abstract:Most previous few-shot action recognition works tend to process video temporal and spatial features separately, resulting in insufficient extraction of comprehensive features. In this paper, a novel hybrid attentive prototypical network (HAPN) framework for few-shot action recognition is proposed. Distinguished by its joint processing of temporal and spatial information, the HAPN framework strategically manipulates these dimensions from feature extraction to the attention module, consequently enhancing its ability to perform action recognition tasks. Our framework utilizes the R(2+1)D backbone network, coupling the extraction of integrated temporal and spatial features to ensure a comprehensive understanding of video content. Additionally, our framework introduces the novel Residual Tri-dimensional Attention (ResTriDA) mechanism, specifically designed to augment feature information across the temporal, spatial, and channel dimensions. ResTriDA dynamically enhances crucial aspects of video features by amplifying significant channel-wise features for action distinction, accentuating spatial details vital for capturing the essence of actions within frames, and emphasizing temporal dynamics to capture movement over time. We further propose a prototypical attentive matching module (PAM) built on the concept of metric learning to resolve the overfitting issue common in few-shot tasks. We evaluate our HAPN framework on three classical few-shot action recognition datasets: Kinetics-100, UCF101, and HMDB51. The results indicate that our framework significantly outperformed state-of-the-art methods. Notably, the 1-shot task, demonstrated an increase of 9.8

Enhancing Few-Shot Action Recognition Using Skeleton Temporal Alignment and Adversarial Training

Revisiting the Spatial and Temporal Modeling for Few-shot Action Recognition

TTAN: Two-Stage Temporal Alignment Network for Few-shot Action Recognition

Learning Spatial-Preserved Skeleton Representations for Few-Shot Action Recognition.

Temporal-spatial Feature Fusion for Few-shot Skeleton-based Action Recognition.

Searching for Better Spatio-temporal Alignment in Few-Shot Action Recognition

Elastic Temporal Alignment for Few‐shot Action Recognition

Temporal-Viewpoint Transportation Plan for Skeletal Few-shot Action Recognition

On the Importance of Spatial Relations for Few-shot Action Recognition

SMAM: Self and Mutual Adaptive Matching for Skeleton-Based Few-Shot Action Recognition

Hybrid Attentive Prototypical Network for Few-Shot Action Recognition

Few-shot action recognition with implicit temporal alignment and pair similarity optimization

Parallel Attention Interaction Network for Few-Shot Skeleton-Based Action Recognition

TA2N: Two-Stage Action Alignment Network for Few-Shot Action Recognition.

Learning Spatial-Temporal Decoupling Representations for Few-Shot Action Recognition

Spatial-Temporal Adaptive Metric Learning Network for One-Shot Skeleton-Based Action Recognition

One-Shot Action Recognition via Multi-Scale Spatial-Temporal Skeleton Matching

An efficient framework for few-shot skeleton-based temporal action segmentation

D^2ST-Adapter: Disentangled-and-Deformable Spatio-Temporal Adapter for Few-shot Action Recognition

Cross-Modal Contrastive Pre-training for Few-Shot Skeleton Action Recognition