Vegetation segmentation using oblique photogrammetry point clouds based on RSPT network

Hong HuZhangyu SunRuihong KangYanlan WuBaoguo Wanga School of Resources and Environmental Engineering,Anhui University,Hefei,People's Republic of Chinab Anhui Province Engineering Laboratory for Mine Ecological Remediation,Hefei,People's Republic of Chinac School of Artificial Intelligence,Anhui University,Hefei,People's Republic of Chinad Bengbu Geotechnical Engineering and Surveying Institute,Bengbu,People's Republic of China
DOI: https://doi.org/10.1080/17538947.2024.2310083
IF: 4.606
2024-02-07
International Journal of Digital Earth
Abstract:Vegetation segmentation via point cloud data can provide important information for urban planning and environmental protection. The point cloud dataset is obtained using light detection and ranging (LiDAR) or RGB-D images. Oblique photogrammetry has received little attention as another important source of point cloud data. We present a pointwise annotated oblique photogrammetry point-cloud dataset that contains rich RGB information, texture, and structural features. This dataset contains five regions of Bengbu, China, with more than twenty thousand samples in this paper. Obviously, previous indoor point cloud semantic segmentation models are no longer applicable to oblique photogrammetry point clouds. A random sampling point transformer (RSPT) network is proposed to enhance vegetation segmentation accuracy. The RSPT model offers both efficient and lightweight architecture. In RSPT, random point sampling is utilized to downsample point clouds, and a local feature aggregation module based on self-attention is designed to extract additional representation features. The network also incorporated residual and dense connections (ResiDense) to capture both local and comprehensive features. Compared to state-of-the-art models, RSPT achieves notable improvements. The intersection over union (IoU) metric increased from 96.0% to 96.5%, the F1-score increased from 90.8% to 97.0%, and the overall accuracy (OA) increased from 91.9% to 96.9%.
geography, physical,remote sensing
What problem does this paper attempt to address?