Abstract:Action recognition has received increasing attention from the computer vision and machine learning communities in the last decade. Although many related action recognition algorithms have been proposed, similar environments conditions are often required in the training and testing stages, which limits the application of the related technologies. In order to accelerate the generalization of action recognition, in this paper, the cross-domain action recognition problem are explored by three different kinds of aspects: 1) feature learning, hand-crafted feature and deep learning feature are extracted, respectively, and then the generalization ability of them are assessed and discussed on controlled and uncontrolled environments, respectively; 2) unsupervised cross-domain learning, since it is difficult for us to obtain the labeled samples in the target domain, thus, unsupervised cross-domain learning methods can be borrowed. In order to discuss which one is suitable for open domain action recognition problem, thus, three kind of unsupervised cross-domain learning methods are assessed on open domain action recognition dataset, respectively; 3) supervised cross-domain learning, if there are some labeled samples in the target domain, but the number of them is very limited, thus, supervised cross-domain learning method should be a good choice, but, how do we make the decision for them? Therefore, these methods are also appraised on the same dataset. Moreover, we contribute a novel multi-view and multi-modality human action recognition dataset (abbreviated as ” $MMA$ ”). It consists of 7,080 action samples from 25 action categories, including 15 single-subject actions and 10 double-subject interactive actions in three views of two different scenarios, which can be utilized to simultaneously explore single-view learning, multi-view learning, multi-modality learning, and cross-domain learning problems. We further explore the same learning problems on the MMA dataset. The extensive experimental results on two different datasets show that the deep feature learning method has much better generalization ability than the hand-crafted feature, such as improved dense trajectory if there are enough labeled samples in the training dataset to be used to fine-tune the network, and both unsupervised cross-domain learning method and supervised cross-domain learning method can improve the performance, but the latter can obtain much bigger improvement, in other words, the labeled samples in the target domain are very helpful. Finally, we also attended the open domain action recognition challenge which was held in CVPR 2017 workshop, and our supervised cross-domain learning scheme obtained the best performance in all teams.

Towards Cross Domain CSI Action Recognition Through One-Shot Bimodal Domain Adaptation

Multiscale Attention-Based Subdomain Dynamic Adaptation for Cross-Domain Scene Classification

Domain Adaptation for Infrared-Radar Cross-Scene Multimodal Detection

Cross-Domain CSI-Based Activity Recognition Via Iterative Soft Labeling and Domain Alignment

Unsupervised Domain Adaptation by Causal Learning for Biometric Signal-based HCI

B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition.

Subdomain Adaptive Learning Network for Cross-Domain Human Activities Recognition Using WiFi with CSI.

Cross-domain video action recognition via adaptive gradual learning

CDFi: Cross-Domain Action Recognition using WiFi Signals

Dynamic Video Mix-Up for Cross-Domain Action Recognition

Semi-supervised human action recognition via dual-stream cross-fusion and class-aware memory bank

A Semi-Supervised Transfer Learning with Dynamic Associate Domain Adaptation for Human Activity Recognition Using WiFi Signals

DMSD-CDFSAR: Distillation from Mixed-Source Domain for Cross-Domain Few-shot Action Recognition

Unsupervised Domain Adaptation in Activity Recognition: A GAN-Based Approach

Multi-modal Instance Refinement for Cross-domain Action Recognition

Learning from Temporal Spatial Cubism for Cross-Dataset Skeleton-based Action Recognition

Exploring the Cross-Domain Action Recognition Problem by Deep Feature Learning and Cross-Domain Learning

CSI-Based Cross-Domain Activity Recognition via Zero-Shot Prototypical Networks

A Pairwise Attentive Adversarial Spatiotemporal Network for Cross-Domain Few-Shot Action Recognition-R2.

Cross-domain few-shot action recognition with unlabeled videos

A Transformer-Based Unsupervised Domain Adaptation Method for Skeleton Behavior Recognition.