Familiarity Is Key: Exploring the Effect of Familiarity on the Face-Voice Correlation

Sarah V. Stevenage,Rebecca Edey,Rebecca Keay,Rebecca Morrison,David J. Robertson
DOI: https://doi.org/10.3390/brainsci14020112
IF: 3.333
2024-01-24
Brain Sciences
Abstract:Recent research has examined the extent to which face and voice processing are associated by virtue of the fact that both tap into a common person perception system. However, existing findings do not yet fully clarify the role of familiarity in this association. Given this, two experiments are presented that examine face-voice correlations for unfamiliar stimuli (Experiment 1) and for familiar stimuli (Experiment 2). With care being taken to use tasks that avoid floor and ceiling effects and that use realistic speech-based voice clips, the results suggested a significant positive but small-sized correlation between face and voice processing when recognizing unfamiliar individuals. In contrast, the correlation when matching familiar individuals was significant and positive, but much larger. The results supported the existing literature suggesting that face and voice processing are aligned as constituents of an overarching person perception system. However, the difference in magnitude of their association here reinforced the view that familiar and unfamiliar stimuli are processed in different ways. This likely reflects the importance of a pre-existing mental representation and cross-talk within the neural architectures when processing familiar faces and voices, and yet the reliance on more superficial stimulus-based and modality-specific analysis when processing unfamiliar faces and voices.
neurosciences
What problem does this paper attempt to address?
The paper primarily explores the relationship between face and voice processing, with a particular focus on how familiarity affects this association. The study is conducted through two experiments: 1. **Experiment 1 with Unfamiliar Stimuli**: - **Objective**: To verify whether there is a correlation between face and voice processing when matching unfamiliar faces and voices under natural stimulus conditions. - **Method**: - The Glasgow Face Matching Test (GFMT) was used for the face matching task with unfamiliar faces. - A new unfamiliar voice matching task was designed, using natural language segments instead of simple vowels. - **Results**: The results showed a significant but weak positive correlation (r = 0.143, p(one-tailed) = 0.037) when matching unfamiliar faces and voices. This indicates that although the correlation is weak, it still exists. 2. **Experiment 2 with Familiar Stimuli**: - **Objective**: To explore whether there is a stronger correlation between face and voice processing when recognizing familiar faces and voices. - **Method**: - The "Before They Were Famous" task was used to test the recognition of childhood photos of celebrities. - A celebrity voice recognition task was designed, using real language segments. - **Expected Results**: Based on theoretical expectations, it is believed that the processing of familiar faces and voices may exhibit greater similarity, thus a stronger correlation is anticipated. Overall, this paper aims to fill the gap in existing research regarding the correlation between face and voice processing, especially when considering the factor of familiarity. By using more ecologically valid stimulus materials and task designs that avoid ceiling effects, the researchers aim to better understand the association between face and voice processing under different levels of familiarity.