Abstract:To understand how tropical rainforests will adapt to climate change and the extent to which their diversity imparts resilience, precise, taxonomically informed monitoring of individual trees is required. However, the density, diversity and complexity of tropical rainforests present considerable challenges to remote mapping and traditional field-based approaches are limited in scale. This study introduces a new approach for mapping tree species linking a multi-temporal implementation of the convolutional neural network method, detectree2, to segment tree-crowns from aerial photographs and machine learning classification to identify species from hyperspectral data (416 - 2500 nm). We build upon previous work in two ways. Firstly, we aimed to improve the accuracy of crown delineations by surveying the same patch of forest with UAV-RGB ten times over six months and fusing multi-date information on the location and shape of individual trees. Secondly, we extended the scope of species identification to include far more species than has been previously attempted (169 compared to 20 previously). We trained and tested our algorithms on subsets of a database of 3500 ground truth, labelled tree crown polygons representing 239 species in French Guiana that we delineated by hand and field verified. We assessed how well our segmentation approach could locate and delineate individual tree crowns and how well our classification approach predicted the species of those crowns. We extracted information on waveband importance for distinguishing species from our classification model. Based on an existing phylogeny of the species in our dataset, we tested for phylogenetic signal across the hyperspectral bands and probed how species were being classified by comparing the phylogenetic signal to the importance of bands for separating species. The accuracy of delineations increased gradually as additional dates of tree crown maps were stacked and combined. Stacking increased the F1-score from 0.69 (a single date) to 0.78 (all dates). The overall (weighted) F1-score for species classification within the site was 0.75. A total of 65 species were predicted from the hyperspectral data with F1-score > 0.7. The performance for classifying species increased with the number of crowns of that species available in the dataset: 8 training crowns were needed to achieve an expected test F1-score = 0.7 for crown level classification within site. With this new approach, we assessed that 70% of tree crown area at landscape-scale was accurately mapped. The most important wavebands for discriminating species were narrowly clumped on the NIR side of the red edge region (748 - 775 nm). While most wavebands showed some phylogenetic signal, waveband importance for species classification was negatively correlated with phylogenetic signal. Our integrated approach makes a significant contribution to the ongoing development of efficient and accurate methodologies for mapping canopy tree species in tropical forests, providing a framework for mapping trees in diverse tropical forests that is far more comprehensive than its predecessors.

Tree Crown Delineation Algorithm Based on a Convolutional Neural Network

Individual Tree Crown Detection and Classification of Live and Dead Trees Using a Mask Region-Based Convolutional Neural Network (mask R-CNN)

Detecting and Mapping Tree Crowns Based on Convolutional Neural Network and Google Earth Images

Automated tree-crown and height detection in a young forest plantation using mask region-based convolutional neural network (Mask R-CNN)

3D-CNN with Multi-Scale Fusion for Tree Crown Segmentation and Species Classification

Individual Tree-Crown Detection in RGB Imagery Using Semi-Supervised Deep Learning Neural Networks

Towards comprehensive individual tree species mapping in diverse tropical forests by harnessing temporal and spectral dimensions

Individual Tree-Crown Delineation and Treetop Detection in High-Spatial-Resolution Aerial Imagery

The Co-Effect of Image Resolution and Crown Size on Deep Learning for Individual Tree Detection and Delineation

Individual Tree Species Identification and Crown Parameters Extraction Based on Mask R-CNN: Assessing the Applicability of Unmanned Aerial Vehicle Optical Images

A New Individual Tree Species Recognition Method Based on a Convolutional Neural Network and High-Spatial Resolution Remote Sensing Imagery

Individual Tree Crown Delineation Using Airborne LiDAR Data and Aerial Imagery in the Taiga–Tundra Ecotone

Att-Mask R-CNN: an individual tree crown instance segmentation method based on fused attention mechanism

Comparison of Classical Methods and Mask R-CNN for Automatic Tree Detection and Mapping Using UAV Imagery

Tree Crown Segmentation and Diameter at Breast Height Prediction Based on BlendMask in Unmanned Aerial Vehicle Imagery

Multi-Species Individual Tree Segmentation and Identification Based on Improved Mask R-CNN and UAV Imagery in Mixed Forests

Automated Tree Crown Labeling with 3D Radiative Transfer Modelling Achieves Human Comparable Performances for Tree Segmentation in Semi-Arid Landscapes

Individual Tree-Crown Detection and Species Identification in Heterogeneous Forests Using Aerial RGB Imagery and Deep Learning

ACE R-CNN: An Attention Complementary and Edge Detection-Based Instance Segmentation Algorithm for Individual Tree Species Identification Using UAV RGB Images and LiDAR Data

Automatic Detection Tree Crown and Height Using Mask R-Cnn Based on Unmanned Aerial Vehicles Images for Biomass Mapping

Tree crown detection and delineation in high resolution RS image: a texture approach discussion