Abstract:Recent advances in 3-D sensors and 3-D modeling have led to the availability of massive amounts of 3-D data. It is too onerous and time consuming to manually label a plentiful of 3-D objects in real applications. In this article, we address this issue by transferring the knowledge from the existing labeled data (e.g., the annotated 2-D images or 3-D objects) to the unlabeled 3-D objects. Specifically, we propose a domain-adversarial guided siamese network (DAGSN) for unsupervised cross-domain 3-D object retrieval (CD3DOR). It is mainly composed of three key modules: 1) siamese network-based visual feature learning; 2) mutual information (MI)-based feature enhancement; and 3) conditional domain classifier-based feature adaptation. First, we design a siamese network to encode both 3-D objects and 2-D images from two domains because of its balanced accuracy and efficiency. Besides, it can guarantee the same transformation applied to both domains, which is crucial for the positive domain shift. The core issue for the retrieval task is to improve the capability of feature abstraction, but the previous CD3DOR approaches merely focus on how to eliminate the domain shift. We solve this problem by maximizing the MI between the input 3-D object or 2-D image data and the high-level feature in the second module. To eliminate the domain shift, we design a conditional domain classifier, which can exploit multiplicative interactions between the features and predictive labels, to enforce the joint alignment in both feature level and category level. Consequently, the network can generate domain-invariant yet discriminative features for both domains, which is essential for CD3DOR. Extensive experiments on two protocols, including the cross-dataset 3-D object retrieval protocol (3-D to 3-D) on PSB/NTU, and the cross-modal 3-D object retrieval protocol (2-D to 3-D) on MI3DOR-2, demonstrate that the proposed DAGSN can significantly outperform state-of-the-art CD3DOR methods.

Structured Serialization Semantic Transfer Network for Unsupervised Cross-Domain Recognition and Retrieval

Structure-Aware Semantic-Aligned Network for Universal Cross-Domain Retrieval

Semantic Consistency Knowledge Transfer for Unsupervised Cross Domain Object Detection

Structured discriminative tensor dictionary learning for unsupervised domain adaptation

Domain-Adversarial-Guided Siamese Network for Unsupervised Cross-Domain 3-D Object Retrieval

Universal unsupervised cross-domain 3D shape retrieval

Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation with Transformer

Towards Uncovering the Intrinsic Data Structures for Unsupervised Domain Adaptation using Structurally Regularized Deep Clustering

Align and Adapt: A Two-stage Adaptation Framework for Unsupervised Domain Adaptation

Sparse-to-dense Feature Matching: Intra and Inter Domain Cross-modal Learning in Domain Adaptation for 3D Semantic Segmentation

Unsupervised Multi-Source Domain Adaptation with Graph Convolution Network and Multi-Alignment in Mixed Latent Space

Learning Semantic Representations for Unsupervised Domain Adaptation.

Structure-Aware Residual-Center Representation for Self-Supervised Open-Set 3D Cross-Modal Retrieval

Unsupervised Cross-Modality Domain Adaptation Network for X-Ray to CT Registration

Unsupervised Domain Adaptation Network with Category-Centric Prototype Aligner for Biomedical Image Segmentation

Domain Adaptive Semantic Segmentation Through Structure Enhancement

CTS: Sim-to-Real Unsupervised Domain Adaptation on 3D Detection

CSCL: Critical Semantic-Consistent Learning for Unsupervised Domain Adaptation

An Adversarial Domain Adaptation Network for Cross-Domain Fine-Grained Recognition

A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images

DCST: Dual Cross-Supervision for Transformer-based Unsupervised Domain Adaptation