Depth Any Canopy: Leveraging Depth Foundation Models for Canopy Height Estimation

Daniele Rege Cambrin,Isaac Corley,Paolo Garza
2024-08-08
Abstract:Estimating global tree canopy height is crucial for forest conservation and climate change applications. However, capturing high-resolution ground truth canopy height using LiDAR is expensive and not available globally. An efficient alternative is to train a canopy height estimator to operate on single-view remotely sensed imagery. The primary obstacle to this approach is that these methods require significant training data to generalize well globally and across uncommon edge cases. Recent monocular depth estimation foundation models have show strong zero-shot performance even for complex scenes. In this paper we leverage the representations learned by these models to transfer to the remote sensing domain for measuring canopy height. Our findings suggest that our proposed Depth Any Canopy, the result of fine-tuning the Depth Anything v2 model for canopy height estimation, provides a performant and efficient solution, surpassing the current state-of-the-art with superior or comparable performance using only a fraction of the computational resources and parameters. Furthermore, our approach requires less than \$1.30 in compute and results in an estimated carbon footprint of 0.14 kgCO2. Code, experimental results, and model checkpoints are openly available at <a class="link-external link-https" href="https://github.com/DarthReca/depth-any-canopy" rel="external noopener nofollow">this https URL</a>.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The paper aims to address the issue of global tree canopy height estimation. Traditional methods such as field measurements or using LiDAR (Light Detection and Ranging) for aerial laser scanning, although accurate, are costly and time-consuming, making them unsuitable for large-scale global applications. Additionally, each data collection method has its limitations and errors. Therefore, there is an urgent need for a more convenient and cost-effective method for canopy height estimation. The authors propose a new method called "Depth Any Canopy," which achieves the goal of estimating canopy height from remote sensing images by fine-tuning the state-of-the-art monocular depth estimation base model Depth Anything v2. This method not only outperforms the current state-of-the-art in terms of performance but also significantly reduces the computational resources and number of parameters used. Specifically, compared to existing methods, this method requires less than $1.30 in computational costs and produces a carbon footprint of only 0.14 kilograms of CO2. This indicates that the method is efficient and low-cost, making it suitable for global canopy height estimation work, thereby contributing to better management and response to climate change.