Abstract:This paper aims to evidence the inherently metonymic nature of co-speech gestures. Arguing that motivation in gesture involves iconicity (similarity), indexicality (contiguity), and habit (conventionality) to varying degrees, it demonstrates how a set of metonymic principles may lend a certain systematicity to experientially grounded processes of gestural abstraction and enaction. Introducing visuo-kinetic signs as an umbrella term for co-speech gestures and signed languages, the paper shows how a frame-based approach to gesture may integrate different cognitive/functional linguistic and semiotic accounts of metonymy (e.g., experiential domains, frame metonymy, contiguity, and pragmatic inferencing). The guiding assumption is that gestures metonymically profile deeply embodied, routinized aspects of familiar scenes, that is, the motivating context of frames. The discussion shows how gestures may evoke frame structures exhibiting varying degrees of groundedness, complexity, and schematicity: basic physical action and object frames; more complex frames; and highly abstract, complex frame structures. It thereby provides gestural evidence for the idea that metonymy is more basic and more directly experientially grounded than metaphor and thus often feeds into correlated metaphoric processes. Furthermore, the paper offers some initial insights into how metonymy also seems to induce the emergence of schematic patterns in gesture which may result from action-based and discourse-driven processes of habituation and conventionalization. It exemplifies how these forces may engender grammaticalization of a basic physical action into a gestural marker that shows strong metonymic form reduction, decreased transitivity, and interacting pragmatic functions. Finally, addressing basic metonymic operations in signed lexemes elucidates certain similarities regarding sign constitution in gesture and sign. English and German multimodal discourse data as well as German Sign Language (DGS) are drawn upon to illustrate the theoretical points of the paper. Overall, this paper presents a unified account of metonymy's role in underpinning forms, functions, and patterns in visuo-kinetic signs.

Protocol for identifying shared articulatory features of gestures and LSF: application to epistemic gesture

Gesture–speech physics in fluent speech and rhythmic upper limb movements

The study of gesture in cognitive linguistics: How it could inform and inspire other research in cognitive science

Motion capture-based animated characters for the study of speech-gesture integration

Examining Gesture Production in the Presence of Communication Challenges

Leveraging Speech for Gesture Detection in Multimodal Communication

Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation

User-Defined Gestures for Gestural Interaction: Extending from Hands to Other Body Parts

Probing Language Models' Gesture Understanding for Enhanced Human-AI Interaction

Co-speech head nods are used to enhance prosodic prominence at different levels of narrow focus in French

Cognitive Grammar and gesture: Points of convergence, advances and challenges

Semantic hand gesture integration system using self-co-articulation and movement epenthesis detection

Beyond the Edge: Markerless Pose Estimation of Speech Articulators from Ultrasound and Camera Images Using DeepLabCut

Channel Selection for Gesture Recognition Using Force Myography: A Universal Model for Gesture Measurement Points

Visuo-Kinetic Signs Are Inherently Metonymic: How Embodied Metonymy Motivates Forms, Functions, and Schematic Patterns in Gesture

Decoding kinematic information from beta-band motor rhythms of speech motor cortex: A methodological/analytic approach using concurrent speech movement tracking and magnetoencephalography

Fusion of kinematic and physiological sensors for hand gesture recognition

Speakers’ Gestures and Semantic Analysis

Phonetic differences between affirmative and feedback head nods in German Sign Language (DGS): A pose estimation study

Many morphs: Parsing gesture signals from the noise