Abstract:To understand how tropical rainforests will adapt to climate change and the extent to which their diversity imparts resilience, precise, taxonomically informed monitoring of individual trees is required. However, the density, diversity and complexity of tropical rainforests present considerable challenges to remote mapping and traditional field-based approaches are limited in scale. This study introduces a new approach for mapping tree species linking a multi-temporal implementation of the convolutional neural network method, detectree2, to segment tree-crowns from aerial photographs and machine learning classification to identify species from hyperspectral data (416 - 2500 nm). We build upon previous work in two ways. Firstly, we aimed to improve the accuracy of crown delineations by surveying the same patch of forest with UAV-RGB ten times over six months and fusing multi-date information on the location and shape of individual trees. Secondly, we extended the scope of species identification to include far more species than has been previously attempted (169 compared to 20 previously). We trained and tested our algorithms on subsets of a database of 3500 ground truth, labelled tree crown polygons representing 239 species in French Guiana that we delineated by hand and field verified. We assessed how well our segmentation approach could locate and delineate individual tree crowns and how well our classification approach predicted the species of those crowns. We extracted information on waveband importance for distinguishing species from our classification model. Based on an existing phylogeny of the species in our dataset, we tested for phylogenetic signal across the hyperspectral bands and probed how species were being classified by comparing the phylogenetic signal to the importance of bands for separating species. The accuracy of delineations increased gradually as additional dates of tree crown maps were stacked and combined. Stacking increased the F1-score from 0.69 (a single date) to 0.78 (all dates). The overall (weighted) F1-score for species classification within the site was 0.75. A total of 65 species were predicted from the hyperspectral data with F1-score > 0.7. The performance for classifying species increased with the number of crowns of that species available in the dataset: 8 training crowns were needed to achieve an expected test F1-score = 0.7 for crown level classification within site. With this new approach, we assessed that 70% of tree crown area at landscape-scale was accurately mapped. The most important wavebands for discriminating species were narrowly clumped on the NIR side of the red edge region (748 - 775 nm). While most wavebands showed some phylogenetic signal, waveband importance for species classification was negatively correlated with phylogenetic signal. Our integrated approach makes a significant contribution to the ongoing development of efficient and accurate methodologies for mapping canopy tree species in tropical forests, providing a framework for mapping trees in diverse tropical forests that is far more comprehensive than its predecessors.

Towards comprehensive individual tree species mapping in diverse tropical forests by harnessing temporal and spectral dimensions

Operational Tree Species Mapping in a Diverse Tropical Forest with Airborne Imaging Spectroscopy

Tree crown segmentation and species classification in a wet eucalypt forest from airborne hyperspectral and LiDAR data

Individual tree crown maps for the National Ecological Observatory Network

Tree Crown Delineation Algorithm Based on a Convolutional Neural Network

The CCB-ID approach to tree species mapping with airborne imaging spectroscopy

Individual canopy tree species maps for the National Ecological Observatory Network

Individual Tree Species Identification and Crown Parameters Extraction Based on Mask R-CNN: Assessing the Applicability of Unmanned Aerial Vehicle Optical Images

Remote sensing approaches to identify trees to species-level in the urban forest: A review

Individual Tree Crown Segmentation and Classification of 13 Tree Species Using Airborne Hyperspectral Data

3D-CNN with Multi-Scale Fusion for Tree Crown Segmentation and Species Classification

Individual Tree Detection in Large-Scale Urban Environments using High-Resolution Multispectral Imagery

Three-dimensional Segmentation of Trees Through a Flexible Multi-Class Graph Cut Algorithm (MCGC)

Exploring the Limits of Species Identification via a Convolutional Neural Network in a Complex Forest Scene through Simulated Imaging Spectroscopy

Individual Tree-Crown Detection and Species Identification in Heterogeneous Forests Using Aerial RGB Imagery and Deep Learning

A New Method for 3D Individual Tree Extraction Using Multispectral Airborne LiDAR Point Clouds

Deep Learning Approaches for the Mapping of Tree Species Diversity in a Tropical Wetland Using Airborne LiDAR and High-Spatial-Resolution Remote Sensing Images

Multi-task fully convolutional network for tree species mapping in dense forests using small training hyperspectral data

Individual Tree-Crown Delineation and Treetop Detection in High-Spatial-Resolution Aerial Imagery

Fusion of Dense Airborne LiDAR and Multispectral Sentinel-2 and Pleiades Satellite Imagery for Mapping Riparian Forest Species Biodiversity at Tree Level

Monitoring leaf phenology in moist tropical forests by applying a superpixel-based deep learning method to time-series images of tree canopies