Abstract:Existing research on the 2D image-based 3D model retrieval task focuses on learning transferable representations directly to narrow the domain discrepancy. However, it is not easy to achieve in practice due to the significant variations across two domains. In addition, some methods design a domain discriminator to distinguish the feature arising from source or target domains for transferable feature representations learning, which will lead to an unexpected deterioration of the feature discriminability. To settle these problems, we propose jointly learning transferable and discriminative representations for 2D image-based 3D model retrieval. Specifically, we extract features from the 2D images and 3D models (described as multiple views) by CNN. Considering the difficulty of directly narrowing the discrepancy of two domains, we are prone to connect 2D image and 3D model domains to an intermediate domain, where the domain gap aims to be eliminated. However, the feature transferability does not denote well discriminability. Based on the batch spectral penalization (BSP) theory, the feature transferability is dominated by feature vectors with higher singular values, while the feature discriminability depends on more eigenvectors with lower singular values to convey rich discriminative structures. Therefore, we penalize the largest singular values so that the feature vectors with lower singular values are appropriately enhanced, thereby strengthening feature discriminability. A series of experiments on two challenging datasets, MI3DOR and MI3DOR-2, indicate that our method can significantly improve performance.

Exploring Discriminative Views for 3D Object Retrieval.

View-based 3D object retrieval with discriminative views.

Feature Representation for 3D Object Retrieval Based on Unconstrained Multi-View

Viewpoint-Aware Representation for Sketch-Based 3D Model Retrieval

View-Based Discriminative Probabilistic Modeling for 3D Object Retrieval and Recognition

Less is More: Efficient 3-D Object Retrieval with Query View Selection.

Statistical Modeling and Many-to-many Matching for View-Based 3D Object Retrieval

View-based 3D Object Retrieval Via Multi-Modal Graph Learning

Domain-Specific Modeling and Semantic Alignment for Image-Based 3d Model Retrieval

Multi-View 3d Object Retrieval with Deep Embedding Network

3-D Object Retrieval With Hausdorff Distance Learning

View-Based 3-D Model Retrieval: A Benchmark

Multi-View Object Retrieval Via Multi-Scale Topic Models.

Multiple Discrimination and Pairwise CNN for view-based 3D object retrieval

Learning Descriptors with Cube Loss for View-Based 3-D Object Retrieval

Efficient View-Based 3-D Object Retrieval Via Hypergraph Learning

3-D Object Retrieval and Recognition with Hypergraph Analysis

Learning Transferable and Discriminative Representations for 2D Image-Based 3D Model Retrieval

3D Object Retrieval with Multimodal Views.

Learning-Based Bipartite Graph Matching for View-Based 3D Model Retrieval.

Camera Constraint-Free View-Based 3-D Object Retrieval