Low-Cost Tree Crown Dieback Estimation Using Deep Learning-Based Segmentation

M. J. Allen,D. Moreno-Fernández,P. Ruiz-Benito,S. W. D. Grieve,E. R. Lines
2024-09-13
Abstract:The global increase in observed forest dieback, characterised by the death of tree foliage, heralds widespread decline in forest ecosystems. This degradation causes significant changes to ecosystem services and functions, including habitat provision and carbon sequestration, which can be difficult to detect using traditional monitoring techniques, highlighting the need for large-scale and high-frequency monitoring. Contemporary developments in the instruments and methods to gather and process data at large-scales mean this monitoring is now possible. In particular, the advancement of low-cost drone technology and deep learning on consumer-level hardware provide new opportunities. Here, we use an approach based on deep learning and vegetation indices to assess crown dieback from RGB aerial data without the need for expensive instrumentation such as LiDAR. We use an iterative approach to match crown footprints predicted by deep learning with field-based inventory data from a Mediterranean ecosystem exhibiting drought-induced dieback, and compare expert field-based crown dieback estimation with vegetation index-based estimates. We obtain high overall segmentation accuracy (mAP: 0.519) without the need for additional technical development of the underlying Mask R-CNN model, underscoring the potential of these approaches for non-expert use and proving their applicability to real-world conservation. We also find colour-coordinate based estimates of dieback correlate well with expert field-based estimation. Substituting ground truth for Mask R-CNN model predictions showed negligible impact on dieback estimates, indicating robustness. Our findings demonstrate the potential of automated data collection and processing, including the application of deep learning, to improve the coverage, speed and cost of forest dieback monitoring.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the large - scale and low - cost monitoring of forest crown dieback. Specifically, the authors aim to develop a deep - learning - based segmentation method to assess the dieback of tree canopies using RGB images taken by drones, without relying on expensive equipment such as LiDAR. ### Background and Problem Description of the Paper The phenomenon of forest crown dieback observed worldwide is increasing, which indicates the widespread decline of forest ecosystems. This degradation will lead to significant changes in ecosystem services and functions, including the loss of habitat provision and carbon sink functions, and these changes are difficult to detect by traditional monitoring techniques. Therefore, there is an urgent need for large - scale and high - frequency monitoring. However, traditional ground - based and drone - based monitoring techniques are not cost - effective when applied on a large scale. To meet this challenge, the authors take advantage of low - cost drone technology and the progress of deep learning on consumer - level hardware, and propose a new method to achieve low - cost and efficient monitoring of crown dieback. ### Specific Problems and Solutions 1. **Requirement for large - scale and high - frequency monitoring**: Traditional monitoring methods are limited in coverage and frequency and cannot capture changes in forest health in a timely manner. To this end, the authors have developed a deep - learning - based segmentation method that can extract the outlines of individual tree crowns from RGB images taken by drones and assess their degree of dieback. 2. **Low - cost and high - efficiency**: This method does not require expensive LiDAR equipment or cumbersome field work, thereby reducing the cost and technical threshold of monitoring, enabling non - expert users to use these tools for effective forest monitoring as well. 3. **Accuracy verification**: The authors verified the accuracy of the method by matching the predicted tree - crown outlines with field - measurement data. They also compared the dieback estimates based on vegetation indices with the results of expert field assessments and found a high correlation between the two, proving the effectiveness of the method. ### Main Contributions - **Automated data collection and processing**: By combining deep learning and drone technology, large - scale, rapid and low - cost monitoring of forest crown dieback has been achieved. - **High accuracy**: Without additional technology development, a relatively high segmentation accuracy (mAP: 0.519) has been achieved and robustness has been maintained in different regions. - **Potential for practical applications**: This method is not only applicable to the research field, but can also provide strong support for actual forest protection and management, especially in dealing with the threats brought by climate change. In conclusion, this paper shows how to use modern technological means to improve forest health monitoring, increasing the coverage, speed and cost - effectiveness of monitoring, and providing new tools and ideas for solving the challenges of large - scale forest protection.