Abstract:Recognizing human actions from varied views is challenging due to huge appearance variations in different views. The key to this problem is to learn discriminant view-invariant representations generalizing well across views. In this paper, we address this problem by learning view-invariant representations hierarchically using a novel method, referred to as Joint Sparse Representation and Distribution Adaptation (JSRDA). To obtain robust and informative feature representations, we first incorporate a sample-affinity matrix into the marginalized stacked denoising Autoencoder (mSDA) to obtain shared features, which are then combined with the private features. In order to make the feature representations of videos across views transferable, we then learn a transferable dictionary pair simultaneously from pairs of videos taken at different views to encourage each action video across views to have the same sparse representation. However, the distribution difference across views still exists because a unified subspace where the sparse representations of one action across views are the same may not exist when the view difference is large. Therefore, we propose a novel unsupervised distribution adaptation method that learns a set of projections that project the source and target views data into respective low-dimensional subspaces where the marginal and conditional distribution differences are reduced simultaneously. Therefore, the finally learned feature representation is view-invariant and robust for substantial distribution difference across views even the view difference is large. Experimental results on four multiview datasets show that our approach outperforms the state-ofthe-art approaches.

View-invariant action recognition via Unsupervised AttentioN Transfer (UANT)

Attention Transfer (ANT) Network for View-invariant Action Recognition

View-invariant action recognition:a survey

View-invariant Human Action Recognition Via Robust Locally Adaptive Multi-View Learning

View-Invariant Human Action Recognition Via View Transformation Network (VTN).

Shifting Perspective to See Difference: A Novel Multi-View Method for Skeleton Based Action Recognition

Arbitrary-view human action recognition via novel-view action generation

Action Recognition Unrestricted by Location and Viewpoint Variation

View-Robust Neural Networks for Unseen Human Action Recognition in Videos

Unsupervised View-Invariant Human Posture Representation

Spatial-Temporal Alignment Network for Action Recognition

Unsupervised Learning of View-invariant Action Representations

Spatial-temporal hypergraph based on dual-stage attention network for multi-view data lightweight action recognition

Hierarchically Learned View-Invariant Representations for Cross-View Action Recognition

Human Action Recognition from Video Sequences by Enforcing Tri-view Constraints

A Novel View Attention Network for Skeleton Based Human Action Recognition*

Unified Spatio-Temporal Attention Models for Advanced Human Action Recognition & Detection

Viewpoint insensitive posture representation for action recognition

Spatio-Temporal Attention Deep Network for Skeleton Based View-Invariant Human Action Recognition

Spatial-Temporal Alignment Network for Action Recognition and Detection

Weakly supervised cross-view action recognition via sequential motion accumulation