Abstract:Most studies investigating neural representations of species-specific vocalizations in non-human primates and other species have involved studying neural responses to vocalization tokens. One limitation of such approaches is the difficulty in determining which acoustical features of vocalizations evoke neural responses. Traditionally used filtering techniques are often inadequate in manipulating features of complex vocalizations. Furthermore, the use of vocalization tokens cannot fully account for intrinsic stochastic variations of vocalizations that are crucial in understanding the neural codes for categorizing and discriminating vocalizations differing along multiple feature dimensions. In this work, we have taken a rigorous and novel approach to the study of species-specific vocalization processing by creating parametric "virtual vocalization" models of major call types produced by the common marmoset (Callithrix jacchus). The main findings are as follows. 1) Acoustical parameters were measured from a database of the four major call types of the common marmoset. This database was obtained from eight different individuals, and for each individual, we typically obtained hundreds of samples of each major call type. 2) These feature measurements were employed to parameterize models defining representative virtual vocalizations of each call type for each of the eight animals as well as an overall species-representative virtual vocalization averaged across individuals for each call type. 3) Using the same feature-measurement that was applied to the vocalization samples, we measured acoustical features of the virtual vocalizations, including features not explicitly modeled and found the virtual vocalizations to be statistically representative of the callers and call types. 4) The accuracy of the virtual vocalizations was further confirmed by comparing neural responses to real and synthetic virtual vocalizations recorded from awake marmoset auditory cortex. We found a strong agreement between the responses to token vocalizations and their synthetic counterparts. 5) We demonstrated how these virtual vocalization stimuli could be employed to precisely and quantitatively define the notion of vocalization "selectivity" by using stimuli with parameter values both within and outside the naturally occurring ranges. We also showed the potential of the virtual vocalization stimuli in studying issues related to vocalization categorizations by morphing between different call types and individual callers.

Unsupervised discovery of family specific vocal usage in the Mongolian gerbil

Unsupervised discovery of family specific vocal usage in the Mongolian gerbil

Vocal recognition of partners by female prairie voles

Mountable miniature microphones to identify and assign mouse ultrasonic vocalizations

Same data, different results? Evaluating machine learning approaches for individual identification in animal vocalisations

Vocal communication is seasonal in social groups of wild, free-living house mice

ARBUR, a machine learning-based analysis system for relating behaviors and ultrasonic vocalizations of rats

Enhancing the analysis of murine neonatal ultrasonic vocalizations: Development, evaluation, and application of different mathematical models

Mel-frequency cepstral coefficients outperform embeddings from pre-trained convolutional neural networks under noisy conditions for discrimination tasks of individual gibbons

Vocal repertoire and individuality in the plains zebra (Equus quagga)

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalizations using an open-source framework for deep learning

Robust encoding of acoustic identity in alpaca hums – a basis for individual recognition

Vocal Call Locator Benchmark (VCL) for localizing rodent vocalizations from multi-channel audio

Establishment and Application of a Novel Genetic Detection Panel for SNPs in Mongolian Gerbils

Speech-in-noise perception across the lifespan: A comparative study in Mongolian gerbils and humans

Genetic Consequences of Group Living in Mongolian Gerbils

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalisations using an open-source framework for deep learning

AVN: A Deep Learning Approach for the Analysis of Birdsong

Virtual Vocalization Stimuli for Investigating Neural Representations of Species-Specific Vocalizations.

Feature Representations for Automatic Meerkat Vocalization Classification

MUPET—Mouse Ultrasonic Profile ExTraction: A Signal Processing Tool for Rapid and Unsupervised Analysis of Ultrasonic Vocalizations