Abstract:1. Passive acoustic monitoring has become increasingly popular as a practical and cost-effective way of obtaining highly reliable acoustic data in ecological research projects. Increased ease of collecting these data means that, currently, the main bottleneck in ecoacoustic monitoring projects is often the time required for the manual analysis of passively collected recordings. In this study we evaluate the potential and current limitations of BirdNET-Analyzer v2.4, the most advanced and generic deep learning algorithm for bird recognition to date, as a tool to assess bird community composition through the automated analysis of large-scale ecoacoustic data. 2. To this end, we study 3 acoustic datasets comprising a total of 629 environmental soundscapes collected in 194 different sites spread across a 19° latitude span in Europe. We analyze these soundscapes using both BirdNET and manual listening by local expert birders, and we then compare the results obtained through the two methods to evaluate the performance of the algorithm both at the level of each single vocalization and for entire recording sequences (1, 5 or 10 min). 3. Since BirdNET provides a confidence score for each identification, minimum confidence thresholds can be used to filter out identifications with low scores, thus retaining only the most reliable ones. The volume of ecoacoustic data used in this study did not allow us to estimate species-specific minimum confidence thresholds for most taxa, so we instead used and evaluated global confidence thresholds selected for optimized results when consistently applied across all species. 4. Our analyses reveal that BirdNET identifications can be highly reliable if a sufficiently high minimum confidence threshold is used. However, the inevitable trade-off between precision and recall does not allow to obtain satisfactory results for both metrics at the same time. We found that F1-scores remain moderate (<0.5) for all datasets and confidence thresholds studied, and that acoustic datasets of extended duration seem to be currently necessary for BirdNET to provide a reliable and minimally comprehensive picture of the target bird community. We estimate, however, that the usage of species- and context-specific minimum confidence thresholds would allow to substantially improve the global performance benchmarks obtained in this study. 5. We conclude that a judicious use of AI-based identifications provided by BirdNET can represent a powerful method to assist in the assessment of bird community composition through the automated analysis of ecoacoustic data, especially when applied to acoustic datasets of extended duration.

The machine learning–powered BirdNET App reduces barriers to global bird research by enabling citizen science participation

BirdLasser: The influence of a mobile app on a citizen science project

BirdNET is as good as experts for acoustic bird monitoring in a European city

eBird: A citizen-based bird observation network in the biological sciences

Assessing the potential of BirdNET to infer European bird communities from large-scale ecoacoustic data

A post‐processing framework for assessing BirdNET identification accuracy and community composition

Guidelines for appropriate use of BirdNET scores and other detector outputs

Exploring the landscape of automated species identification apps: Development, promise, and user appraisal

A ready-to use workflow for automated, sound-based bird identification and localization

Living Together, Singing Together: Revealing Similar Patterns of Vocal Activity in Two Tropical Songbirds Applying BirdNET

Spot that Bird: A Location Based Bird Game

SatBird: Bird Species Distribution Modeling with Remote Sensing and Citizen Science Data

TinyChirp: Bird Song Recognition Using TinyML Models on Low-power Wireless Acoustic Sensors

Artificial intelligence (BirdNET) supplements manual methods to maximize bird species richness from acoustic datasets generated from regional monitoring

A novel deep learning‐based bioacoustic approach for identification of look‐alike white‐eye (Zosterops) species traded in wildlife markets

SSL-Net: A Synergistic Spectral and Learning-based Network for Efficient Bird Sound Classification

Deep learning-based methods for individual recognition in small birds

5G AI-IoT System for Bird Species Monitoring and Song Classification

Removing Human Bottlenecks in Bird Classification Using Camera Trap Images and Deep Learning

Global birdsong embeddings enable superior transfer learning for bioacoustic classification

Western Mediterranean wetlands bird species classification: evaluating small-footprint deep learning approaches on a new annotated dataset