Abstract:Action recognition has received increasing attention from the computer vision and machine learning communities in the last decade. Although many related action recognition algorithms have been proposed, similar environments conditions are often required in the training and testing stages, which limits the application of the related technologies. In order to accelerate the generalization of action recognition, in this paper, the cross-domain action recognition problem are explored by three different kinds of aspects: 1) feature learning, hand-crafted feature and deep learning feature are extracted, respectively, and then the generalization ability of them are assessed and discussed on controlled and uncontrolled environments, respectively; 2) unsupervised cross-domain learning, since it is difficult for us to obtain the labeled samples in the target domain, thus, unsupervised cross-domain learning methods can be borrowed. In order to discuss which one is suitable for open domain action recognition problem, thus, three kind of unsupervised cross-domain learning methods are assessed on open domain action recognition dataset, respectively; 3) supervised cross-domain learning, if there are some labeled samples in the target domain, but the number of them is very limited, thus, supervised cross-domain learning method should be a good choice, but, how do we make the decision for them? Therefore, these methods are also appraised on the same dataset. Moreover, we contribute a novel multi-view and multi-modality human action recognition dataset (abbreviated as ” $MMA$ ”). It consists of 7,080 action samples from 25 action categories, including 15 single-subject actions and 10 double-subject interactive actions in three views of two different scenarios, which can be utilized to simultaneously explore single-view learning, multi-view learning, multi-modality learning, and cross-domain learning problems. We further explore the same learning problems on the MMA dataset. The extensive experimental results on two different datasets show that the deep feature learning method has much better generalization ability than the hand-crafted feature, such as improved dense trajectory if there are enough labeled samples in the training dataset to be used to fine-tune the network, and both unsupervised cross-domain learning method and supervised cross-domain learning method can improve the performance, but the latter can obtain much bigger improvement, in other words, the labeled samples in the target domain are very helpful. Finally, we also attended the open domain action recognition challenge which was held in CVPR 2017 workshop, and our supervised cross-domain learning scheme obtained the best performance in all teams.

Cross-Dataset Pose Estimation of Faces in the Wild

Global Adaptation Meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimation.

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Learning Causal Representation for Training Cross-Domain Pose Estimator Via Generative Interventions

Cross-Domain Adaptation for Animal Pose Estimation.

Enhanced 3D Pose Estimation in Multi-Person, Multi-View Scenarios through Unsupervised Domain Adaptation with Dropout Discriminator

Generalizing Monocular 3d Human Pose Estimation In The Wild

Learning 3-D Face Shape from Diverse Sources with Cross-Domain Face Synthesis

DUA: A Domain-Unified Approach for Cross-Dataset 3D Human Pose Estimation

Multi-Person Pose Estimation in the Wild: Using Adversarial Method to Train a Top-Down Pose Estimation Network

Domain Adaptation on Point Clouds for 6D Pose Estimation in Bin-Picking Scenarios

Towards Generalization of 3D Human Pose Estimation In The Wild

Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervision

Domain adaptive pose estimation via multi-level alignment

Alleviating Human-level Shift : A Robust Domain Adaptation Method for Multi-person Pose Estimation

Dynamic Attention Based Domain Generalization for Face Anti-Spoofing.

Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recovery

Towards Multi-Domain Face Synthesis Via Domain-Invariant Representations and Multi-Level Feature Parts.

Exploring the Cross-Domain Action Recognition Problem by Deep Feature Learning and Cross-Domain Learning

Cross-Domain 3D Model Retrieval Via Visual Domain Adaption

Monocular 3D Human Pose Estimation with Domain Feature Alignment and Self Training