Abstract:In recent years, the automatic analysis of natural environment images acquired with unmanned aerial vehicles (UAV) has rapidly gained popularity. UAVs are specially important in mountainous forests where access is difficult and large areas need to be surveyed. In Zao mountains in northeastern Japan, regenerated fir saplings are competing with sub-alpine vegetation shrubs after a severe fir tree mortality caused by bark beetle infestation. A detailed survey of vegetation distribution is key to improve our understanding of species succession and the influence of climate change in that process. To that end, we evaluated the suitability of deep-learning-based automatic image classification of UAV images in order to map sub-alpine vegetation succession in large areas and the potential of fir regeneration. In order to assess the contribution of this technology in this research field, we first conducted an observer study to assess the difficulty for humans of the task of classifying vegetation from images. Afterwards, we compared the observers' accuracy to four state-of-the art deep learning networks for automatic image classification. The best observer accuracy of 55% demonstrates the limitations of species classification using only images. Furthermore, a detailed analysis of the sources of error showed that even though humans could differentiate between deciduous and evergreen species with an accuracy of 96%, identifying the correct species within each group proved much more challenging. In contrast, deep learning networks achieved accuracy values in the range of 70–80% for species classification, clearly demonstrating capabilities beyond human experts. Our experiments also indicated that the performance of these networks was significantly influenced by the similarity between the datasets used to fine-tune them and evaluate them. This fact highlights the importance of building publicly available images databases to further improve the results. Nevertheless, the results presented in this paper show that the analysis of UAV-acquired with deep learning networks can usher in a new type of large-scale study, spanning tenths or even hundreds of hectares with high spatial resolution (of a few cms per pixel), providing the ability to assess challenging vegetation dynamics problems that go beyond the ability of conventional fieldwork methodologies.

Night-Time Measurement and Skeleton Recognition Using Unmanned Aerial Vehicles Equipped with LiDAR Sensors Based on Deep Learning Algorithms

Fast Detection and Recognition Method of UAV in Sky Background

Mmskeleton: 3D Human Skeleton Estimation Using Millimeter Wave Radar Sparse Point Clouds

Surface and underwater human pose recognition based on temporal 3D point cloud deep learning

Deep Learning-Based Human Body Posture Recognition and Tracking for Unmanned Aerial Vehicles

Unmanned aerial vehicles for human detection and recognition using neural-network model

Utilizing a Single-Stage 2D Detector in 3D LiDAR Point Cloud With Vertical Cylindrical Coordinate Projection for Human Identification

UAV Infrared Image Human and Vehicle Object Detection Based on YOLOv5

Efficient Detection and Tracking of Human Using 3D LiDAR Sensor

SkyNet: Multi-Drone Cooperation for Real-Time Person Identification and Localization.

Research on Detection and Recognition Technology of a Visible and Infrared Dim and Small Target Based on Deep Learning

Fine Classification of UAV Urban Nighttime Light Images Based on Object-Oriented Approach

Personnel Detection in Dark Aquatic Environments Based on Infrared Thermal Imaging Technology and an Improved YOLOv5s Model

A 2D-Lidar-Equipped Unmanned Robot-Based Approach for Indoor Human Activity Detection

Nighttime Motorcycle Detection for Sparse Traffic Images Using Machine Learning

Single Person Identification and Activity Estimation in a Room from Waist-Level Contours Captured by 2D Light Detection and Ranging

Consciousness Detection on Injured Simulated Patients Using Manual and Automatic Classification via Visible and Infrared Imaging

A 3D Object Recognition Method From LiDAR Point Cloud Based on USAE-BLS

An Enhanced Target Detection Algorithm for Maritime Search and Rescue Based on Aerial Images

LRSNet: a high-efficiency lightweight model for object detection in remote sensing

Sub-alpine shrub classification using UAV images: Performance of human observers vs DL classifiers