Abstract:Accurate and automatic identification of tree species information at the individual tree scale is of great significance for fine-scale investigation and management of forest resources and scientific assessment of forest ecosystems. Despite the fact that numerous studies have been conducted on the delineation of individual tree crown and species classification using drone high-resolution red, green and blue (RGB) images, and Light Detection and Ranging (LiDAR) data, performing the above tasks simultaneously has rarely been explored, especially in complex forest environments. In this study, we improve upon the state of the Mask region-based convolution neural network (Mask R-CNN) with our proposed attention complementary network (ACNet) and edge detection R-CNN (ACE R-CNN) for individual tree species identification in high-density and complex forest environments. First, we propose ACNet as the feature extraction backbone network to fuse the weighted features extracted from RGB images and canopy height model (CHM) data through an attention complementary module, which is able to selectively fuse weighted features extracted from RGB and CHM data at different scales, and enables the network to focus on more effective information. Second, edge loss is added to the loss function to improve the edge accuracy of the segmentation, which is calculated through the edge detection filter introduced in the Mask branch of Mask R-CNN. We demonstrate the performance of ACE R-CNN for individual tree species identification in three experimental areas of different tree species in southern China with precision (P), recall (R), F1-score, and average precision (AP) above 0.9. Our proposed ACNet–the backbone network for feature extraction–has better performance in individual tree species identification compared with the ResNet50-FPN (feature pyramid network). The addition of the edge loss obtained by the Sobel filter further improves the identification accuracy of individual tree species and accelerates the convergence speed of the model training. This work demonstrates the improved performance of ACE R-CNN for individual tree species identification and provides a new solution for tree-level species identification in complex forest environments, which can support carbon stock estimation and biodiversity assessment.

Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images

Accurate Strawberry Plant Detection System Based on Low-altitude Remote Sensing and Deep Learning Technologies

Detection of Strawberry Flowers in Outdoor Field by Deep Neural Network

An Instance Segmentation Framework Based on Parallelogram Mask for Crop Row Detection in Various Farmlands

Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages

Hybrid Rice Row Detection at the Pollination Stage Based on Vanishing Point and Line-Scanning Method

An Automated Framework for Plant Detection Based on Deep Simulated Learning from Drone Imagery

Improved Mask R-CNN for Aircraft Detection in Remote Sensing Images

Att-Mask R-CNN: an individual tree crown instance segmentation method based on fused attention mechanism

High-Precision Seedling Detection Model Based on Multi-Activation Layer and Depth-Separable Convolution Using Images Acquired by Drones

Strawberry R-CNN: Recognition and counting model of strawberry based on improved faster R-CNN

Hybrid receptive field network for small object detection on drone view

Drone Detection Method Based on MobileViT and CA-PANet

Fusing attention mechanism with Mask R-CNN for instance segmentation of grape cluster in the field

A Novel Greenhouse-Based System for the Detection and Plumpness Assessment of Strawberry Using an Improved Deep Learning Technique

MFRENet: efficient detection of drone image based on multiscale feature aggregation and receptive field expanded

Estimation of Strawberry Canopy Volume in Unmanned Aerial Vehicle RGB Imagery Using an Object Detection-Based Convolutional Neural Network

Using a Bunch Testing Time Augmentations to Detect Rice Plants Based on Aerial Photography

Object Detection in High-Resolution UAV Aerial Remote Sensing Images of Blueberry Canopy Fruits

ACE R-CNN: An Attention Complementary and Edge Detection-Based Instance Segmentation Algorithm for Individual Tree Species Identification Using UAV RGB Images and LiDAR Data

Dragon fruit detection in natural orchard environment by integrating lightweight network and attention mechanism