Abstract:3D (three-dimensional) models are widely applied in our daily life, such as mechanical manufacture, games, biochemistry, art, virtual reality, and etc. With the exponential growth of 3D models on web and in model library, there is an increasing need to retrieve the desired model accurately according to freehand sketch. Researchers are focusing on applying machine learning technology to 3D model retrieval. In this article, we combine semantic feature, shape distribution features and gist feature to retrieve 3D model based on interactive attention convolutional neural networks (CNN). The purpose is to improve the accuracy of 3D model retrieval. Firstly, 2D (two-dimensional) views are extracted from 3D model at six different angles and converted into line drawings. Secondly, interactive attention module is embedded into CNN to extract semantic features, which adds data interaction between two CNN layers. Interactive attention CNN extracts effective features from 2D views. Gist algorithm and 2D shape distribution (SD) algorithm are used to extract global features. Thirdly, Euclidean distance is adopted to calculate the similarity of semantic feature, the similarity of gist feature and the similarity of shape distribution feature between sketch and 2D view. Then, the weighted sum of three similarities is used to compute the similarity between sketch and 2D view for retrieving 3D model. It solves the problem that low accuracy of 3D model retrieval is caused by the poor extraction of semantic features. Nearest neighbor (NN), first tier (FT), second tier (ST), F-measure (E(F)), and discounted cumulated gain (DCG) are used to evaluate the performance of 3D model retrieval. Experiments are conducted on ModelNet40 and results show that the proposed method is better than others. The proposed method is feasible in 3D model retrieval.

3D model semantic classification and retrieval with Gaussian processes

Semantic-oriented 3D model classification and retrieval using Gaussian processes

3D Model Retrieval with Multi-Granular Semantics Based on Gaussian Process Classifier

An Overview of Semantics Processing in Content-Based 3D Model Retrieval

Research and Realization on 3D Model Retrieval Based on Hybrid Shape Feature

Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting

A spatial Gaussian process method for hyperspectral remote sensing imagery classification

Gaussian process and its applications in hyperspectral image classification

Band selection based gaussian processes for hyperspectral remote sensing images classification

A New Sketch-Based 3D Model Retrieval Approach by Using Global and Local Features

Mapping Features to Semantic Space for 3D Model Retrieval

SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAM

InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perception

3D Model Classification Based on GCN and SVM

GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplane

2D-Guided 3D Gaussian Segmentation

3D model retrieval based on interactive attention CNN and multiple features

Learning Part-aware 3D Representations by Fusing 2D Gaussians and Superquadrics

Large Point-to-Gaussian Model for Image-to-3D Generation

GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Prediction

Using Multi-Scale and Hierarchical Deep Convolutional Features for 3D Semantic Classification of TLS Point Clouds.