Abstract:Advances in bioacoustic technology, such as the use of automatic recording devices, allow wildlife monitoring at large spatial scales. However, such technology can produce enormous amounts of audio data that must be processed and analyzed. One potential solution to this problem is the use of automated sound recognition tools, but we lack a general framework for developing and validating these tools. Recognizers are computer models of an animal sound assembled from "training data" (i.e., actual samples of vocalizations). The settings of variables used to create recognizers can impact performance, and the use of different settings can result in large differences in error rates that can be exploited for different monitoring objectives. We used Song Scope (Wildlife Acoustics Inc.) to build recognizers and vocalizations of the wood frog (Lithobates sylvaticus) to test how different settings and amounts of training data influence recognizer performance. Performance was evaluated using precision (the probability of a recognizer match being a true match) and sensitivity (the proportion of vocalizations detected) based on a receiver operating characteristic (ROC) curve-determined score threshold. Evaluations were conducted using recordings not used to build the recognizer. Wood frog recognizer performance was sensitive to setting changes in four out of nine variables, and small improvements were achieved by using additional training data from different sites and from the same recording, but not from different recordings from the same site. Overall, the effect of changes to variable settings was much greater than the effect of increasing training data. Additionally, by testing the performance of the recognizer on vocalizations not used to build the recognizer, we discovered that Type I error rates appear idiosyncratic and do not recommend extrapolation from training to new data, whereas Type II errors showed more consistency and extrapolation can be justified. Optimizing variable settings on independent recordings led to a better match between recognizer performance and monitoring objectives. We provide general recommendations for application of this methodology with other species and make some suggestions for improvements.

Poster Abstract: Long-Term Monitoring of Cane-Toads Using Acoustic Sensors

Passive acoustic monitoring and automated detection of the American bullfrog

In Situ Cane Toad Recognition

Aquatic soundscape recordings reveal diverse vocalizations and nocturnal activity of an endangered frog

New Weapons in the Toad Toolkit: A Review of Methods to Control and Mitigate the Biodiversity Impacts of Invasive Cane Toads (Rhinella Marina)

Teacher toads: Buffering apex predators from toxic invaders in a remote tropical landscape

Deep learning-based detector of invasive alien frogs, Polypedates leucomystax and Rhinella marina, on an island at invasion front

Designing better frog call recognition models

Adaptive Representations of Sound for Automatic Insect Recognition

Deploying Acoustic Detection Algorithms on Low-Cost, Open-Source Acoustic Sensors for Environmental Monitoring

Chronic recording of brain activity in awake toads

A new method to estimate abundance of Australasian Bittern (Botaurus poiciloptilus) from acoustic recordings

Using the ecological significance of animal vocalizations to improve inference in acoustic monitoring programs

Coexisting good neighbours: acoustic and calling microhabitat niche partitioning in two elusive syntopic species of balloon frogs, Uperodon systoma and U. globulosus (Anura: Microhylidae) and potential of individual vocal signatures

Anuran accents: Continental‐scale citizen science data reveal spatial and temporal patterns of call variability

Taste aversion training can educate free-ranging crocodiles against toxic invaders

Automated acoustic detection of Geoffroy's spider monkey highlights tipping points of human disturbance

So many toadfish, so little time

Acute impacts of invasive toads on the population demography of a native predator in tropical Australia

Visualization of a chorus structure in multiple frog species by a sound discrimination device

From little things big things grow: enhancement of an acoustic telemetry network to monitor broad-scale movements of marine species along Australia's east coast