Integrating Biological Data into Autonomous Remote Sensing Systems for In Situ Imageomics: A Case Study for Kenyan Animal Behavior Sensing with Unmanned Aerial Vehicles (UAVs)

Jenna M. Kline,Maksim Kholiavchenko,Otto Brookes,Tanya Berger-Wolf,Charles V. Stewart,Christopher Stewart

2024-07-24

Abstract:In situ imageomics leverages machine learning techniques to infer biological traits from images collected in the field, or in situ, to study individuals organisms, groups of wildlife, and whole ecosystems. Such datasets provide real-time social and environmental context to inferred biological traits, which can enable new, data-driven conservation and ecosystem management. The development of machine learning techniques to extract biological traits from images are impeded by the volume and quality data required to train these models. Autonomous, unmanned aerial vehicles (UAVs), are well suited to collect in situ imageomics data as they can traverse remote terrain quickly to collect large volumes of data with greater consistency and reliability compared to manually piloted UAV missions. However, little guidance exists on optimizing autonomous UAV missions for the purposes of remote sensing for conservation and biodiversity monitoring. The UAV video dataset curated by KABR: In-Situ Dataset for Kenyan Animal Behavior Recognition from Drone Videos required three weeks to collect, a time-consuming and expensive endeavor. Our analysis of KABR revealed that a third of the videos gathered were unusable for the purposes of inferring wildlife behavior. We analyzed the flight telemetry data from portions of UAV videos that were usable for inferring wildlife behavior, and demonstrate how these insights can be integrated into an autonomous remote sensing system to track wildlife in real time. Our autonomous remote sensing system optimizes the UAV's actions to increase the yield of usable data, and matches the flight path of an expert pilot with an 87% accuracy rate, representing an 18.2% improvement in accuracy over previously proposed methods.

Robotics

What problem does this paper attempt to address?

The main objective of this paper is to address the issue of how to efficiently collect image data for biological behavior analysis using Unmanned Aerial Vehicles (UAVs) in field environments. Specifically, the paper focuses on the following aspects:

1. **Improving Data Quality**: A significant portion of the data collected by UAVs is currently unusable for behavior analysis due to factors such as lighting and viewing angles. The paper aims to identify the optimal flight parameters (such as altitude and speed) to ensure that the collected data can be better utilized by machine learning algorithms.

2. **Optimizing Autonomous Navigation Systems**: By analyzing flight telemetry data from effective video segments, researchers have improved existing autonomous navigation models. The new model can adjust its position horizontally and dynamically adjust flight altitude to keep the target animal within an appropriate field of view.

3. **Enhancing Data Utilization**: The study found that only a portion of the data collected using current methods is usable. By optimizing flight strategies, the amount of effective data for behavior recognition can be significantly increased. For example, in experiments, the new navigation model increased action matching accuracy from 68.8% to 87%, and the F1 score also improved.

4. **Reducing Manual Intervention Costs**: Compared to manual operation, autonomous UAVs have clear advantages in terms of cost, safety, and consistency. By optimizing the UAV's behavior tracking capabilities, research costs can be further reduced, and data collection efficiency can be improved.

In summary, through a series of technical and methodological improvements, this paper aims to enhance the application of UAVs in field biological behavior monitoring, providing more valuable data support for ecological conservation and ecosystem management.