Using spatiotemporal information in weather radar data to detect and track communal roosts
Gustavo Perez,Wenlong Zhao,Zezhou Cheng,Maria Carolina T. D. Belotti,Yuting Deng,Victoria F. Simons,Elske Tielens,Jeffrey F. Kelly,Kyle G. Horton,Subhransu Maji,Daniel Sheldon
DOI: https://doi.org/10.1002/rse2.388
IF: 5.7874
2024-04-19
Remote Sensing in Ecology and Conservation
Abstract:We developed and deployed an AI‐assisted system to annotate roosts in radar data. We deployed the system to collect swallow information from 12 US radar stations around the Great Lakes spanning 21 years. The deployment on Great Lakes radar scans allows accelerated annotation of 15 628 roost signatures from 612 786 radar scans. Our AI‐assisted system reduces human annotation effort, and the inclusion of temporal information to the system achieves significant improvement, successfully extracting research‐grade historical roost data. The exodus of flying animals from their roosting locations is often visible as expanding ring‐shaped patterns in weather radar data. The NEXRAD network, for example, archives more than 25 years of data across 143 contiguous US radar stations, providing opportunities to study roosting locations and times and the ecosystems of birds and bats. However, access to this information is limited by the cost of manually annotating millions of radar scans. We develop and deploy an AI‐assisted system to annotate roosts in radar data. We build datasets with roost annotations to support the training and evaluation of automated detection models. Roosts are detected, tracked, and incorporated into our developed web‐based interface for human screening to produce research‐grade annotations. We deploy the system to collect swallow and martin roost information from 12 radar stations around the Great Lakes spanning 21 years. After verifying the practical value of the system, we propose to improve the detector by incorporating both spatial and temporal channels from volumetric radar scans. The deployment on Great Lakes radar scans allows accelerated annotation of 15 628 roost signatures in 612 786 radar scans with 183.6 human screening hours, or 1.08 s per radar scan. We estimate that the deployed system reduces human annotation time by ~7×. The temporal detector model improves the average precision at intersection‐over‐union threshold 0.5 (APIoU = .50) by 8% over the previous model (48%→56%), further reducing human screening time by 2.3× in its pilot deployment. These data contain critical information about phenology and population trends of swallows and martins, aerial insectivore species experiencing acute declines, and have enabled novel research. We present error analyses, lay the groundwork for continent‐scale historical investigation about these species, and provide a starting point for automating the detection of other family‐specific phenomena in radar data, such as bat roosts and mayfly hatches.
ecology,remote sensing