Abstract:In cross-view action recognition, "what you saw" in one view is different from "what you recognize" in another view. The data distribution even the feature space can change from one view to another due to the appearance and motion of actions drastically vary across different views. In this paper, we address the problem of transferring action models learned in one view (source view) to another different view (target view), where action instances from these two views are represented by heterogeneous features. A novel learning method, called Heterogeneous Transfer Discriminantanalysis of Canonical Correlations (HTDCC), is proposed to learn a discriminative common feature space for linking source and target views to transfer knowledge between them. Two projection matrices that respectively map data from source and target views into the common space are optimized via simultaneously minimizing the canonical correlations of inter-class samples and maximizing the intraclass canonical correlations. Our model is neither restricted to corresponding action instances in the two views nor restricted to the same type of feature, and can handle only a few or even no labeled samples available in the target view. To reduce the data distribution mismatch between the source and target views in the common feature space, a nonparametric criterion is included in the objective function. We additionally propose a joint weight learning method to fuse multiple source-view action classifiers for recognition in the target view. Different combination weights are assigned to different source views, with each weight presenting how contributive the corresponding source view is to the target view. The proposed method is evaluated on the IXMAS multi-view dataset and achieves promising results.

Enhancing cross-view object classification by feature-based transfer learning

A Hybrid Transfer Learning Mechanism for Object Classification across View

Transferring Training Instances for Convenient Cross-View Object Classification in Surveillance

Cross-view object classification in traffic scene surveillance based on transductive transfer learning

Active learning for transferrable object classification in cross-view traffic scene surveillance

Object View Classification By Selective Transfer Learning With Gentleboost

Multi-view Moving Objects Classification Via Transfer Learning

Object view clasfication by selective transer learning wih GentleBoost

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Cross-View Action Recognition over Heterogeneous Feature Spaces

Cross-modality Online Distillation for Multi-View Action Recognition

Cross-domain Object Detection by Local to Global Object-Aware Feature Alignment

Cross-domain Distribution Calibration of Hyperspectral Image Classification

View Independent Object Classification by Exploring Scene Consistency Information for Traffic Scene Surveillance

Cross-View Feature Learning for Scalable Social Image Analysis.

Source-Guided Target Feature Reconstruction for Cross-Domain Classification and Detection

Cross-view Action Recognition Via Transductive Transfer Learning

Cross-View Gait-Based Gender Classification by Transfer Learning.

Active Learning with Cross-Class Knowledge Transfer.

Cross-Transfer Learning for Enhancing Object Detection in Remote Sensing Images

Feature Selection via Transferring Knowledge Across Different Classes