Similarity learning networks for animal individual re-identification: an ecological perspective

Stefan Schneider,Graham W. Taylor,Stefan C. Kremer
DOI: https://doi.org/10.1007/s42991-021-00215-1
2022-04-27
Mammalian Biology
Abstract:The ability for researchers to re-identify animal individuals upon re-encounter is fundamental for the study of population dynamics, community, and behavioural ecology. Animal re-identification is traditionally performed using tagging or DNA sampling, which is laborious, invasive to an animal, and expensive. An alternative approach to re-identify is the use of computer vision in combination with pattern recognition algorithms. Deep learning has accelerated the success when solving pattern recognition in the field of computer vision when high data volume is available; however, conventional deep learning approaches require ample training data for a fixed number of classes. An alternative deep learning paradigm is similarity comparison networks which are trained to identify if two inputs are the same or different. This principle can be applied to images of animal individuals and allows for the re-identification of individuals beyond the original training data. Here, we test the potential and generality of similarity comparison networks for animal re-identification considering five datasets of different species: humans, chimpanzees, humpback whales, fruit flies, and Siberian tigers, each with their own unique set of challenges. We compare 10 similarity comparison networks by testing five well-established network architectures (AlexNet, VGG19, DenseNet201, ResNet152, and InceptionV3) and two different methods to train each of them: contrastive and triplet loss. Models were trained to re-identify individuals and those trained using the triplet loss outperformed contrastive loss for all species. Our work shows that without any species-specific modifications, similarity comparison networks can act as a general purpose animal re-identification system considering individuals from images. Our expectation is that similarity comparison networks are the beginning of a major trend that has the potential to revolutionize the study of population dynamics, community, and behavioural ecology. This work is an extension of a technical report presented at WACV 2020 (IEEE/CVF winter conference on applications of computer vision workshops) catered for an ecological audience.
zoology
What problem does this paper attempt to address?