Abstract:Most previous few-shot action recognition works tend to process video temporal and spatial features separately, resulting in insufficient extraction of comprehensive features. In this paper, a novel hybrid attentive prototypical network (HAPN) framework for few-shot action recognition is proposed. Distinguished by its joint processing of temporal and spatial information, the HAPN framework strategically manipulates these dimensions from feature extraction to the attention module, consequently enhancing its ability to perform action recognition tasks. Our framework utilizes the R(2+1)D backbone network, coupling the extraction of integrated temporal and spatial features to ensure a comprehensive understanding of video content. Additionally, our framework introduces the novel Residual Tri-dimensional Attention (ResTriDA) mechanism, specifically designed to augment feature information across the temporal, spatial, and channel dimensions. ResTriDA dynamically enhances crucial aspects of video features by amplifying significant channel-wise features for action distinction, accentuating spatial details vital for capturing the essence of actions within frames, and emphasizing temporal dynamics to capture movement over time. We further propose a prototypical attentive matching module (PAM) built on the concept of metric learning to resolve the overfitting issue common in few-shot tasks. We evaluate our HAPN framework on three classical few-shot action recognition datasets: Kinetics-100, UCF101, and HMDB51. The results indicate that our framework significantly outperformed state-of-the-art methods. Notably, the 1-shot task, demonstrated an increase of 9.8

Task Adaptive Modeling for Few-shot Action Recognition

Revisiting the Spatial and Temporal Modeling for Few-shot Action Recognition

Task-Adapter: Task-specific Adaptation of Image Models for Few-shot Action Recognition

Hybrid Attentive Prototypical Network for Few-Shot Action Recognition

Task-Aware Dual-Representation Network for Few-Shot Action Recognition

Few-shot Action Recognition via Improved Attention with Self-supervision

Task-adaptive Spatial-Temporal Video Sampler for Few-shot Action Recognition

TTAN: Two-Stage Temporal Alignment Network for Few-shot Action Recognition

Few-shot Action Recognition Via Multi-view Representation Learning

Task-Agnostic Self-Distillation for Few-Shot Action Recognition

Few-shot Fine-Grained Action Recognition Via Bidirectional Attention and Contrastive Meta-Learning

Elastic Temporal Alignment for Few‐shot Action Recognition

Few-shot action recognition with implicit temporal alignment and pair similarity optimization

Few-shot Action Recognition with Prototype-centered Attentive Learning

Anomalous Action Recognition Research for Few-shot Learning

Temporal Relation based Attentive Prototype Network for Few-shot Action Recognition.

A Comprehensive Review of Few-shot Action Recognition

Depth Guided Adaptive Meta-Fusion Network for Few-shot Video Recognition

Relational Action Bank with Semantic–Visual Attention for Few-Shot Action Recognition

Few-Shot Action Recognition with Hierarchical Matching and Contrastive Learning

Cross-modal Guides Spatio-Temporal Enrichment Network for Few-Shot Action Recognition