Abstract:The photogrammetric three-dimensional (3D) textured mesh model (TMM) obtained by unmanned aerial vehicle provides accurate geometric shapes and realistic textures. The 3D semantics derived from TMMs serves as the foundation in many applications, such as urban planning, forestry, and smart city. Although 3D TMM provide more features than 2D images, current classification methods have not fully utilized these features, particularly the stereoscopic hierarchical structure of different objects. To address this issue, we propose a hierarchical object-based method for the classification of TMMs, consisting of three key steps: 1) The TMM is firstly hierarchically segmented into ground surface meshes and off-ground 3D objects using a cloth-simulated filtering algorithm. 2) The ground surface mesh is projected to 2D ortho-image, where object-based image classification is used to classify pixels. The resulting semantic labels of pixels are then mapped back to the corresponding mesh model. 3) Instance-level 3D objects are created through connected component analysis of off-ground meshes, and then classified via a 3D object-based approach. The 3D semantic model is generated by merging the outcomes of steps (2) and (3). Experimental results indicate that the stereoscopic hierarchical strategy effectively decomposes a 3D scene into simple ground surfaces and off-ground 3D objects, yielding improvements in both accuracy and efficiency. Our proposed method demonstrates an accuracy increase of over 7% - 36% compared to existing methods. This is the first time a stereoscopic hierarchy has been introduced for classifying 3D textured mesh model, providing a valuable reference for future classification methods.

Using Three-Dimensional Features to Improve Terrain Classification.

Classifying Image Texture with Statistical Landscape Features

Hierarchical 2D/3D Object-based Classification of Photogrammetric Textured Mesh Models

Study on Quasi-3-dimensional Texture Features for Multi-,Hyper-spectral Remote Sensing Data Analysis

Invariant Feature Vector Description for 3D Terrain and Its Application to Terrain Contour Matching

Three-Dimensional Terrain Model Multiview Quality Assessment Considering Human Visual System

3D Iterative Spatiotemporal Filtering for Classification of Multitemporal Satellite Data Sets

Terrain Matching for Three-dimensional Visualization of Two-dimensional GIS Vector Data

3D gray-gradient-gradient tensor field feature for hyperspectral image classification

Research on 3D Terrain Generation and Visualization

Terrain Classification in Forest Environment Based on Combined Features from Laser Range Data

The 3D terrain reconstruction algorithm based on texture mapping

A New Method on Terrain Texture Characteristics Extraction Based on Improved Dual-tree Complex Wavelet Transform

Effective Identification Of Terrain Positions From Gridded Dem Data Using Multimodal Classification Integration

Imaging Lidar Based 3D Terrain Matching Using Feature Vector

Self-Similarity Based Classification of 3D Surface Textures

Statistical Landscape Features for Texture Classification

Measuring Landscape Pattern in Three Dimensional Space

Texture Synthesis Based on Terrain Feature Recognition

Texture Feature Extraction of Hyper-spectral Image with Three-dimensional Gray-level Co-occurrence

High Dimensional Feature for Hyperspectral Image Classification