A toolkit for the dynamic study of air sacs in siamang and other elastic circular structures

Lara S. Burchardt,Yana van de Sande,Mounia Kehy,Marco Gamba,Andrea Ravignani,Wim Pouw
DOI: https://doi.org/10.1371/journal.pcbi.1012222
2024-06-25
PLoS Computational Biology
Abstract:Biological structures are defined by rigid elements, such as bones, and elastic elements, like muscles and membranes. Computer vision advances have enabled automatic tracking of moving animal skeletal poses. Such developments provide insights into complex time-varying dynamics of biological motion. Conversely, the elastic soft-tissues of organisms, like the nose of elephant seals, or the buccal sac of frogs, are poorly studied and no computer vision methods have been proposed. This leaves major gaps in different areas of biology. In primatology, most critically, the function of air sacs is widely debated; many open questions on the role of air sacs in the evolution of animal communication, including human speech, remain unanswered. To support the dynamic study of soft-tissue structures, we present a toolkit for the automated tracking of semi-circular elastic structures in biological video data. The toolkit contains unsupervised computer vision tools (using Hough transform) and supervised deep learning (by adapting DeepLabCut) methodology to track inflation of laryngeal air sacs or other biological spherical objects (e.g., gular cavities). Confirming the value of elastic kinematic analysis, we show that air sac inflation correlates with acoustic markers that likely inform about body size. Finally, we present a pre-processed audiovisual-kinematic dataset of 7+ hours of closeup audiovisual recordings of siamang ( Symphalangus syndactylus ) singing. This toolkit (https://github.com/WimPouw/AirSacTracker) aims to revitalize the study of non-skeletal morphological structures across multiple species. Many animals move not only by activating skeletal muscles, but also by pushing air or fluids into and out of cavities like air sacs. Such cavities can become part of the visible signals emitted by a species and may perform several functions, such as for example sound production or gas exchange. A most notable example of elastic cavities that move in the context of communication is the laryngeal air sac in a small Asian ape called the siamang. There are currently a lot of open questions about the function of these air sacs for primates in general, but the exceptionally visible air sacs in siamang have never been dynamically studied to gain a better understanding of air sacs and their role in vocalizations and communication. To date, no adapted technology exists to track dilating movements of these inflating balloon-like structures. Here we provide a method to perform tracking of elastic circular structures alongside an open access data set of singing siamang with close-ups of the air sac. The techniques overviewed here can be applied to other inflatable structures that are abundant in other animals too.
biochemical research methods,mathematical & computational biology
What problem does this paper attempt to address?