The Uncanny Effect of Speech: The Impact of Appearance and Speaking on Impression Formation in Human–Robot Interactions

Neelu Gurung,Janie Busby Grant,Damith Hearth
DOI: https://doi.org/10.1007/s12369-023-00976-4
IF: 3.802
2023-04-14
International Journal of Social Robotics
Abstract:This study explores the impact of appearance and speech on human perceptions of faces in human- robot interactions. Three videos were generated depicting the real face of an artist and two virtual versions of the same artist, with increasing resolution and fidelity. Each video was presented with and without speech, with matching levels of fidelity to the faces (real human speech and machine- generated speech of two levels of realism). Participants viewed all six videos and rated them on measures such as convincing, trustworthy, realistic, likable, showed biological movement, reassuring, friendly, familiar, and humanness. We found that the inclusion of speech (real) had a significant positive impact on the impression formation of real human appearance. In contrast, perceptions of the virtual avatars were more negative when speech (machine-like) was incorporated. This study illustrates the differential effects that speech can have on virtual faces in interactive settings.
robotics
What problem does this paper attempt to address?