Abstract:Zero-shot learning (ZSL) typically explores a shared semantic space in order to recognize novel categories in the absence of any labeled training data. However, the traditional ZSL methods always suffer from serious domain shift problem in human action recognition. This is because: 1) existing ZSL methods are specifically designed for object recognition from static images, which do not capture the temporal dynamics of video sequences, and poor performances are always generated if those methods are directly applied to zero-shot action recognition; 2) these methods always blindly project the target data into a shared space using a semantic mapping obtained by the source data without any adaptation, in which the underlying structures of target data are ignored; and 3) severe inter-class variations exist in various action categories. The traditional ZSL methods do not take relationships across different categories into consideration. In this paper, we propose a novel aligned dynamic-preserving embedding (ADPE) model for zero-shot action recognition in a transductive setting. In our model, an adaptive embedding of target videos is learned, exploring the distributions of both the source and target data. An aligned regularization is further proposed to couple the centers of target semantic representations with their corresponding label prototypes in order to preserve the relationships across different categories. Most significantly, during our embedding, the temporal dynamics of video sequences are simultaneously preserved via exploiting the temporal consistency of video sequences and capturing the temporal evolution of successive segments of actions. Our model can effectively overcome the domain shift problem in zero-shot action recognition. The experiments on Olympic sports, HMDB51, and UCF101 datasets demonstrate the effectiveness of our model.

MKTZ: multi-semantic embedding and key frame masking techniques for zero-shot skeleton action recognition

Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximization

An Information Compensation Framework for Zero-Shot Skeleton-based Action Recognition

One-Shot Action Recognition via Multi-Scale Spatial-Temporal Skeleton Matching

Multi-Semantic Fusion Model for Generalized Zero-Shot Skeleton-Based Action Recognition

Zero-Shot Skeleton-based Action Recognition with Dual Visual-Text Alignment

Motion-Aware Mask Feature Reconstruction for Skeleton-Based Action Recognition

Improved Key Poses Model for Skeleton-Based Action Recognition.

An optimization method of human skeleton keyframes selection for action recognition

MKE-GCN: Multi-Modal Knowledge Embedded Graph Convolutional Network for Skeleton-Based Action Recognition in the Wild

Semantic-guided multi-scale human skeleton action recognition

Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognition

SMAM: Self and Mutual Adaptive Matching for Skeleton-Based Few-Shot Action Recognition

Learning Spatial-Preserved Skeleton Representations for Few-Shot Action Recognition.

Joint Embedding with Multi-Task Learning for Multi-Label Zero-Shot Action Recognition

Combine Multi-order Representation Learning and Frame Optimization Learning for Skeleton-based Action Recognition

Aligned Dynamic-Preserving Embedding for Zero-Shot Action Recognition.

Motion Complement and Temporal Multifocusing for Skeleton-Based Action Recognition

SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-supervised Skeleton Action Recognition.

Keypoints-based Multimodal Network for Robust Human Action Recognition