Abstract:As one of the most important components of urban space, the geometric and semantic properties of road trees are crucial for the assessment and upgrade of urban environments. Accurate positioning of individual trees is a critical procedure for this task; however, traditional manual methods require considerable personnel and material resources. By contrast, individual tree segmentation based on a vehicle-mounted mobile laser scanner (MLS) operating along urban streets can provide a feasible and efficient solution. Recent studies (especially those based on deep learning) on point cloud semantic segmentation and forest tree detection have achieved significant progress; however, they rarely perform instance recognition of urban trees. In addition, extracting individual urban trees from point clouds to balance accuracy and efficiency remains challenging. To this end, we propose an effective pipeline to segment individual trees from urban MLS data. The proposed approach encompasses two main steps: tree-point extraction and individual-tree segmentation. First, a patch-guided semi-supervised semantic segmentation network was designed to separate non-tree points from entire urban scene. The extracted tree points are further divided into instance-level trees using a three-stage segmentation network for the individual tree segmentation. Specifically, a tree-centroid prediction module is proposed to ensure the accurate localization of street trees, even with irregular positions, in complex urban environments. Subsequently, a special confidence-aware attention mechanism is developed to resolve challenging ambiguities from complementary perspectives. Finally, a dynamic shifting-based clustering algorithm is introduced to speed up the segmentation of each tree guided by the predicted centroid and directly transfer the IDs back to the point clouds. The proposed method is evaluated and validated on MLS point clouds collected in two urban areas, robustly producing accurate instance-level roadside trees. The instance-level segmentation results in average precision and recall of (96.62%, 96.17%) and (95.62%, 94.58%), respectively, on these two MLS point cloud datasets. Point-level segmentation also exhibits mean precision, recall, and weighted coverage exceeding 90%. We also verify that the proposed method could achieve a promising result on an airborne laser scanning point cloud dataset without retraining, thereby demonstrating a good generalization ability. To further verify the quality of the segmented tree instances, a reconstruction method is adopted to employ these independent street trees in trunk point cloud modeling. Our contribution may assist in developing intelligent urban green space planning and management.

Towards general deep-learning-based tree instance segmentation models

TreeLearn: A Comprehensive Deep Learning Method for Segmenting Individual Trees from Ground-Based LiDAR Forest Point Clouds

SegmentAnyTree: A sensor and platform agnostic deep learning model for tree segmentation using laser scanning data

Using Synthetic Tree Data in Deep Learning-Based Tree Segmentation Using LiDAR Point Clouds

Tree Detection and Diameter Estimation Based on Deep Learning

Deep learning for conifer/deciduous classification of airborne LiDAR 3D point clouds representing individual trees

Individual tree extraction from urban mobile laser scanning point clouds using deep pointwise direction embedding

Accelerated Forest Modeling from Tree Canopy Point Clouds Via Deep Learning

THREE-DIMENSIONAL DEEP LEARNING FOR LEAF-WOOD SEGMENTATION OF TROPICAL TREE POINT CLOUDS

A Deep Learning-Based Method for Extracting Standing Wood Feature Parameters from Terrestrial Laser Scanning Point Clouds of Artificially Planted Forest

A scalable approach for tree segmentation within small-footprint airborne LiDAR data

Instance Recognition of Street Trees from Urban Point Clouds Using a Three-Stage Neural Network

Forest-PointNet: A Deep Learning Model for Vertical Structure Segmentation in Complex Forest Scenes

Tree Trunk Detection in Urban Scenes Using a Multiscale Attention-Based Deep Learning Method

ForestSemantic: a dataset for semantic learning of forest from close-range sensing

Automated Segmentation of Individual Tree Structures Using Deep Learning over LiDAR Point Cloud Data

Segmentation of individual trees in urban MLS point clouds using a deep learning framework based on cylindrical convolution network

Automatic Segmentation of Standing Trees from Forest Images Based on Deep Learning

Forest Tree Detection and Segmentation using High Resolution Airborne LiDAR

Road-Side Individual Tree Segmentation from Urban MLS Point Clouds Using Metric Learning

DeepTree: Modeling Trees with Situated Latents