Automation of green roof plant cover measurements using machine learning and a comparison of digital and thermal imaging techniques

Ronglan Cao,J. Scott MacIvor
DOI: https://doi.org/10.1111/avsc.12790
2024-06-20
Applied Vegetation Science
Abstract:Our study describes the application of simple ImageJ tools for developing automated and semi‐automated image segmentation for estimating green roof plant cover. We found that Color Threshold estimation is better aligned with manual segmentation, whereas RGB and thermal imagery present distinct segmentation challenges. Aims Post‐analyses of digital red, green, blue (RGB) and thermal images have become increasingly popular as modern approaches to plant cover analysis. Image analyses are often coupled with semi‐automated or automated workflows to reduce the amount of human labor input compared with traditional manual procedures. This study aims to evaluate and compare different image segmentation methods for plant cover analysis using digital RGB and thermal images, focusing on the effectiveness of semi‐automated and manual segmentation techniques in monitoring plant cover on green roofs. Location An Extensive green roof in the City of Toronto. Methods We surveyed the plant cover of an extensive green roof using digital and thermal imagery. The plant cover values were obtained using three methods: traditional manual segmentation based on a visual examination (MS), ImageJ Color Threshold (CT) and Trainable Weka Segmentation (TWS), all performed within FIJI (a distribution of ImageJ). Manual segmentation based on visual examination was used as a reference standard. Results Significant correlation was found between the cover estimation using the CT and TWS methods relative to MS, and between cover estimation using the thermal image and the RGB image. TWS overestimated plant cover on thermal images while producing an underestimation on RGB images. CT demonstrated a performance closer to MS than TWS, indicating that manually customized methods produced results more aligned with MS. The estimated cover values by MS were not significantly affected by the image type (digital RGB or thermal). Conclusions Results suggest that RGB and thermal imaging techniques may provide complementary results and reveal unique information regarding the functioning of green roofs. The accuracy of supervised machine‐learning methods could be enhanced with site‐specific data to provide a more accurate and efficient estimation of plant cover, which might be beneficial for long‐term studies on green roofs and ecological sites in remote locations.
ecology,plant sciences,forestry
What problem does this paper attempt to address?