Abstract:In recent years, the automatic analysis of natural environment images acquired with unmanned aerial vehicles (UAV) has rapidly gained popularity. UAVs are specially important in mountainous forests where access is difficult and large areas need to be surveyed. In Zao mountains in northeastern Japan, regenerated fir saplings are competing with sub-alpine vegetation shrubs after a severe fir tree mortality caused by bark beetle infestation. A detailed survey of vegetation distribution is key to improve our understanding of species succession and the influence of climate change in that process. To that end, we evaluated the suitability of deep-learning-based automatic image classification of UAV images in order to map sub-alpine vegetation succession in large areas and the potential of fir regeneration. In order to assess the contribution of this technology in this research field, we first conducted an observer study to assess the difficulty for humans of the task of classifying vegetation from images. Afterwards, we compared the observers' accuracy to four state-of-the art deep learning networks for automatic image classification. The best observer accuracy of 55% demonstrates the limitations of species classification using only images. Furthermore, a detailed analysis of the sources of error showed that even though humans could differentiate between deciduous and evergreen species with an accuracy of 96%, identifying the correct species within each group proved much more challenging. In contrast, deep learning networks achieved accuracy values in the range of 70–80% for species classification, clearly demonstrating capabilities beyond human experts. Our experiments also indicated that the performance of these networks was significantly influenced by the similarity between the datasets used to fine-tune them and evaluate them. This fact highlights the importance of building publicly available images databases to further improve the results. Nevertheless, the results presented in this paper show that the analysis of UAV-acquired with deep learning networks can usher in a new type of large-scale study, spanning tenths or even hundreds of hectares with high spatial resolution (of a few cms per pixel), providing the ability to assess challenging vegetation dynamics problems that go beyond the ability of conventional fieldwork methodologies.

Monitoring Method for UAV Image of Greenhouse and Plastic-mulched Landcover Based on Deep Learning

Fast Detection and Recognition Method of UAV in Sky Background

Mapping of plastic greenhouses and mulching films from very high resolution remote sensing imagery based on a dilated and non-local convolutional neural network

Mapping Impervious Surfaces in Town–Rural Transition Belts Using China’s GF-2 Imagery and Object-Based Deep CNNs

Assessing the Potential of UAV for Large-Scale Fractional Vegetation Cover Mapping with Satellite Data and Machine Learning

Field Monitoring of Fractional Vegetation Cover Based on UAV Low-altitude Remote Sensing and Machine Learning

Multi-Temporal Unmanned Aerial Vehicle Remote Sensing for Vegetable Mapping Using an Attention-Based Recurrent Convolutional Neural Network

High-resolution mapping of paddy rice fields from unmanned airborne vehicle images using enhanced-TransUnet

Crop Monitoring using remote sensing land use and land change data: Comparative analysis of deep learning methods using pre-trained CNN models

Deep Learning Structure for Real-time Crop Monitoring Based on Neural Architecture Search and UAV

An Efficient Target Detection and Recognition Method in Aerial Remote-sensing Images Based on Multiangle Regions-of-Interest

Farmland quality assessment using deep fully convolutional neural networks

Land Use Classification Method of Remote Sensing Images for Urban and Rural Planning Monitoring Using Deep Learning

Scene and Environment Monitoring Using Aerial Imagery and Deep Learning

Urban forest monitoring based on multiple features at the single tree scale by UAV

Farmland Segmentation from Remote Sensing Images Using Deep Learning Methods

Sub-alpine shrub classification using UAV images: Performance of human observers vs DL classifiers

Crop classification for UAV visible imagery using deep semantic segmentation methods

Crop-Planting Area Prediction from Multi-Source Gaofen Satellite Images Using a Novel Deep Learning Model: A Case Study of Yangling District

Fully Automated Classification Method for Crops Based on Spatiotemporal Deep-Learning Fusion Technology

Applying deep learning to real-time UAV-based forest monitoring: Leveraging multi-sensor imagery for improved results