Abstract:The photogrammetric three-dimensional (3D) textured mesh model (TMM) obtained by unmanned aerial vehicle provides accurate geometric shapes and realistic textures. The 3D semantics derived from TMMs serves as the foundation in many applications, such as urban planning, forestry, and smart city. Although 3D TMM provide more features than 2D images, current classification methods have not fully utilized these features, particularly the stereoscopic hierarchical structure of different objects. To address this issue, we propose a hierarchical object-based method for the classification of TMMs, consisting of three key steps: 1) The TMM is firstly hierarchically segmented into ground surface meshes and off-ground 3D objects using a cloth-simulated filtering algorithm. 2) The ground surface mesh is projected to 2D ortho-image, where object-based image classification is used to classify pixels. The resulting semantic labels of pixels are then mapped back to the corresponding mesh model. 3) Instance-level 3D objects are created through connected component analysis of off-ground meshes, and then classified via a 3D object-based approach. The 3D semantic model is generated by merging the outcomes of steps (2) and (3). Experimental results indicate that the stereoscopic hierarchical strategy effectively decomposes a 3D scene into simple ground surfaces and off-ground 3D objects, yielding improvements in both accuracy and efficiency. Our proposed method demonstrates an accuracy increase of over 7% - 36% compared to existing methods. This is the first time a stereoscopic hierarchy has been introduced for classifying 3D textured mesh model, providing a valuable reference for future classification methods.

Hierarchical Support Vector Machine Based Structural Classification with Fused Hierarchies

MMF: Multi-Task Multi-Structure Fusion for Hierarchical Image Classification

Hierarchical 1-FSVM Algorithm Based on SMO

Semantic Guided Level-Category Hybrid Prediction Network for Hierarchical Image Classification.

A Hierarchical SVM Based Multiclass Classification by Using Similarity Clustering

Multi-scale Image Semantic Recognition with Hierarchical Visual Vocabulary

User-Centered Image Semantics Classification

Deep Multi-task Learning for Hierarchical Classification

Feature Encoding with Hybrid Heterogeneous Structure Model for Image Classification.

Hierarchical 2D/3D Object-based Classification of Photogrammetric Textured Mesh Models

Joint Hierarchical Category Structure Learning and Large-Scale Image Classification

Hierarchical abstract semantic model for image classification

Image Categorization Based on a Hierarchical Spatial Markov Model

Hierarchical Web Image Classification By Multi-Level Features

Ontology-driven Hierarchical Sparse Coding for Large-Scale Image Classification

Learning a Hierarchical Compositional Shape Vocabulary for Multi-class Object Representation

Discriminative Fast Hierarchical Learning for Multiclass Image Classification

Hierarchical Fine-Grained Visual Classification Leveraging Consistent Hierarchical Knowledge

Hierarchical Support Vector Machines Based on Kernel Cluster

Learning Hierarchical Semantic Classification by Grounding on Consistent Image Segmentations

Incorporating Structural Alternatives and Sharing into Hierarchy for Multiclass Object Recognition and Detection