Abstract:Imaging spectroscopy (hyperspectral sensing) is a proven tool for mapping and monitoring the spatial distribution of vegetation species composition. However, there exists a gap when it comes to the availability of high-resolution spatial and spectral imagery for accurate tree species mapping, particularly in complex forest environments, despite the continuous advancements in operational remote sensing and field sensor technologies. Here, we aim to bridge this gap by enhancing our fundamental understanding of imaging spectrometers via complex simulated environments. We used DIRSIG, a physics-based, first-principles simulation approach to model canopy-level reflectance for 3D plant models and species-level leaf reflectance in a synthetic forest scene. We simulated a realistic scene, based on the same species composition, found at Harvard Forest, MA (USA). Our simulation approach allowed us to better understand the interplay between instrument parameters and landscape characteristics, and facilitated comprehensive traceability of error budgets. To enhance our understanding of the impact of sensor design on classification performance, we simulated image samples at different spatial, spectral, and scale resolutions (by modifying the pixel pitch and the total number of pixels in the sensor array, i.e., the focal plane dimension) of the imaging sensor and assessed the performance of a deep learning-based convolutional neural network (CNN) and a traditional machine learning classifier, support vector machines (SVMs), to classify vegetation species. Overall, across all resolutions and species mixtures, the highest classification accuracy varied widely from 50 to 84%, and the number of genus-level species classes identified ranged from 2 to 17, among 24 classes. Harnessing this simulation approach has provided us valuable insights into sensor configurations and the optimization of data collection methodologies to improve the interpretation of spectral signatures for accurate tree species mapping in forest scenes. Note that we used species classification as a proxy for a host of imaging spectroscopy applications. However, this approach can be extended to other ecological scenarios, such as in evaluating the changing ecosystem composition, detecting invasive species, or observing the effects of climate change on ecosystem diversity.

Variation in forest root image annotation by experts, novices, and AI

Segmentation of roots in soil with U-Net

Divide and conquer: Using RhizoVision Explorer to aggregate data from multiple root scans using image concatenation and statistical methods

When nature meets technology: AI-informed discovery of soil-water-root physical interaction

Use of Unmanned Aerial Vehicles for Monitoring Recovery of Forest Vegetation on Petroleum Well Sites

Assessing the fine root growth dynamics of Norway spruce manipulated by air humidity and soil nitrogen with deep learning segmentation of smartphone images

Deep Learning Tree and Forest Biomass from Sub-Meter Resolution Images

Individual Tree-Crown Detection and Species Identification in Heterogeneous Forests Using Aerial RGB Imagery and Deep Learning

RhizoNet segments plant roots to assess biomass and growth for enabling self-driving labs

Exploring the Limits of Species Identification via a Convolutional Neural Network in a Complex Forest Scene through Simulated Imaging Spectroscopy

Part One Polymers and Fillers

Automatic stitching and segmentation of roots images for the generation of labelled deep learning-ready data

PRMI: A Dataset of Minirhizotron Images for Diverse Plant Root Study

High-Throughput in situ Root Image Segmentation Based on the Improved DeepLabv3+ Method

The Challenge of Data Annotation in Deep Learning—A Case Study on Whole Plant Corn Silage

In vivo length changes of carpal ligaments of the wrist during dart-throwing motion.

New dimension in leaf stomatal behavior analysis: a robust method with machine learning approach

Uncovering natural variation in root system architecture and growth dynamics using a robotics-assisted phenomics platform

Automatic Plant Cover Estimation with Convolutional Neural Networks

Determining the community composition of herbaceous species from images using convolutional neural networks