Insect Identification in the Wild: The AMI Dataset
Aditya Jain,Fagner Cunha,Michael James Bunsen,Juan Sebastián Cañas,Léonard Pasi,Nathan Pinoy,Flemming Helsing,JoAnne Russo,Marc Botham,Michael Sabourin,Jonathan Fréchette,Alexandre Anctil,Yacksecari Lopez,Eduardo Navarro,Filonila Perez Pimentel,Ana Cecilia Zamora,José Alejandro Ramirez Silva,Jonathan Gagnon,Tom August,Kim Bjerge,Alba Gomez Segura,Marc Bélisle,Yves Basset,Kent P. McFarland,David Roy,Toke Thomas Høye,Maxim Larrivée,David Rolnick
2024-09-30
Abstract:Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack of scalable tools for monitoring. Ecologists have started to adopt camera traps to record and study insects, and have proposed computer vision algorithms as an answer for scalable data processing. However, insect monitoring in the wild poses unique challenges that have not yet been addressed within computer vision, including the combination of long-tailed data, extremely similar classes, and significant distribution shifts. We provide the first large-scale machine learning benchmarks for fine-grained insect recognition, designed to match real-world tasks faced by ecologists. Our contributions include a curated dataset of images from citizen science platforms and museums, and an expert-annotated dataset drawn from automated camera traps across multiple continents, designed to test out-of-distribution generalization under field conditions. We train and evaluate a variety of baseline algorithms and introduce a combination of data augmentation techniques that enhance generalization across geographies and hardware setups.
Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning