Abstract:The current methods for multi-view-based 3D object recognition have the problem of losing the correlation between views and rendering 3D objects with multi-view redundancy. This makes it difficult to improve recognition performance and unnecessarily increases the computational cost and running time of the network. Especially in the case of limited computing resources, the recognition performance is further affected. Our study developed an optimal viewset pooling transformer (OVPT) method for efficient and accurate 3D object recognition. The OVPT method constructs the optimal viewset based on information entropy to reduce the redundancy of the multi-view scheme. We used convolutional neural network (CNN) to extract the multi-view low-level local features of the optimal viewset. Embedding class token into the headers of multi-view low-level local features and splicing with position encoding generates local-view token sequences. This sequence was trained parallel with a pooling transformer to generate a local view information token sequence. At the same time, the global class token captured the global feature information of the local view token sequence. The two were aggregated next into a single compact 3D global feature descriptor. On two public benchmarks, ModelNet10 and ModelNet40, for each 3D object we only need a smaller number of optimal viewsets, achieving an overall recognition accuracy (OA) of 99.33% and 97.48%, respectively. Compared with other deep learning methods, our method still achieves state-of-the-art performance with limited computational resources. Our source code is available at https://github.com/shepherds001/OVPT.

Viewpoints Selection of 3D Object Recognition Based on Manifold Topological Multi-resolution Analysis Method

Feature Representation for 3D Object Retrieval Based on Unconstrained Multi-View

3-D Reconstruction of Three Views Based on Manifold Study

Viewpoint-Aware Representation for Sketch-Based 3D Model Retrieval

Variable-Viewpoint Representations for 3D Object Recognition

3d Reconstruction With Multi-View Texture Mapping

OVPT: Optimal Viewset Pooling Transformer for 3D Object Recognition.

Image-based 3D Model Retrieval Using Manifold Learning

Beyond Viewpoint: Robust 3D Object Recognition under Arbitrary Views through Joint Multi-Part Representation

Monocular Viewpoints Estimation for Generic Objects in the Wild

Multi-View Object Retrieval Via Multi-Scale Topic Models.

A classification-based approach for best view selection of 3D models

Improving Viewpoint-Independent Object-Centric Representations through Active Viewpoint Selection

Exploring Discriminative Views for 3D Object Retrieval.

Similarity Voting Based Viewpoint Selection for Volumes

3D RECONSTRUCTION BASED ON 2D VIEW FEATURE

MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding

View-based weight network for 3D object recognition

Unsupervised Multi-View CNN for Salient View Selection and 3D Interest Point Detection

View-based 3D object retrieval with discriminative views.

MVM3Det: A Novel Method for Multi-view Monocular 3D Detection