Abstract:With the continuous improvement of image processing capabilities, a three-dimensional (3D) model that can contain rich information is becoming the fourth type of multimedia data (in addition to sound, image, and video). Moreover, since there is a wide range of applications of 3D models, how to quickly and effectively obtain the correct target model from the massive data has become a key issue. To date, 3D model retrieval approaches have been proposed, and in these approaches, view-based 3D model retrieval methods can achieve satisfactory performance. In the 3D model retrieval task, the latent relationship mining of all images in a 3D model, the adaptive fusion of different images, and the discriminative feature extraction are the main challenges, but in most existing solutions, these issues are separately performed and they are not explored in an end-to-end network architecture. To solve these issues, in this work, we propose a novel and effective multi-level view associative convolution network (MLVACN) to realize view-based 3D model retrieval, where the relationship exploration of multiple-view images, the fusion of different images, and the feature discrimination learning are realized in a unified end-to-end framework. Specifically, we design the group association layer and the block association layer to study the latent relationships among different views from the view-level and the block-level, respectively. Moreover, the weight fusion layer is further designed to adaptively fuse different views in a 3D model. In addition, these three layers are embedded into the MLVACN. Finally, the pairwise discrimination loss function is proposed to learn the discriminative features of the 3D model. Extensive experimental results on three 3D model retrieval datasets including ModelNet40, ModelNet10, and ShapeNetCore55 demonstrate that MLVACN can outperform state-of-the-art methods in term of mAP. When the ModelNet40 dataset is used, th- mAP of MLVACN is improved by 13.25%, 7.75%, 3.95%, and 0.61% as compared to those of the MVCNN, GVCNN, PVNet, and MLVCNN methods, respectively.

Improved Panoramic Representation Via Bidirectional Recurrent View Aggregation for Three-Dimensional Model Retrieval

View-Aware Geometry-Structure Joint Learning for Single-View 3D Shape Reconstruction

Learning Discriminative and Generative Shape Embeddings for Three-Dimensional Shape Retrieval

DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization

Deep Spherical Panoramic Representation for 3D Shape Recognition

An Improved 3D Shape Recognition Method Based on Panoramic View

Panorama based on multi-channel-attention CNN for 3D model recognition

A Dimensional Reduction Guiding Deep Learning Architecture for 3D Shape Retrieval

A Unified Feature Representation and Learning Framework for 3D Shape

ReINView: Re-interpreting Views for Multi-view 3D Object Recognition

PADENet: an Efficient and Robust Panoramic Monocular Depth Estimation Network for Outdoor Scenes.

Multi-View 3d Object Retrieval with Deep Embedding Network

Multi-view Moments Embedding Network for 3D Shape Recognition

PanoRecon: Real-Time Panoptic 3D Reconstruction from Monocular Video

Beyond Viewpoint: Robust 3D Object Recognition under Arbitrary Views through Joint Multi-Part Representation

PVRNet: Point-View Relation Neural Network for 3D Shape Recognition

Multi-Level View Associative Convolution Network for View-Based 3D Model Retrieval

VERAM: View-Enhanced Recurrent Attention Model for 3D Shape Classification

DV-Net: Dual-view Network for 3D Reconstruction by Fusing Multiple Sets of Gated Control Point Clouds

3D Reconstruction for Multi-view Objects

Enhanced multi view 3D reconstruction with improved MVSNet