Abstract:The use of speech-accompanying iconic gestures is a ubiquitous characteristic of human-human communication, especially when spatial information is expressed. At the starting point of this thesis, however, it was a widely open question why different gestures take the particular physical form they actually do. Accordingly, previous computational models simulating the use of gestures were of limited significance. The goal of this thesis was to develop a comprehensive computational simulation model for the production of co-speech iconic gestures to be realized in virtual agents. The rationale behind this objective was to devise and probe a predictive model of gesture use in order to gain insight into human gesture production, and thereby to improve human-agent interaction such that it progresses towards intuitive and human-like communication. As an empirical basis for the generation model, a corpus of natural speech and gesture use was statistically analyzed, revealing novel findings regarding the question when and how speakers use gestures. It was found that iconic gesture use is not only influenced by the shape of the object to depict, but also by other characteristics of the referent, by the linguistic and discourse-contextual situation, as well as a speaker's previous gestural behavior. Further, it could be shown that the role of gestural representation techniques (like placing or drawing) is decisive for the physical form of iconic gestures. And finally, the analysis revealed obvious inter-individual differences, both at the surface of gestural behavior and also in how strong particular influencing relations were. Based on these empirical insights, the Generation Network for Iconic Gestures (GNetIc) was developed – a computational simulation model for the production of speech-accompanying iconic gestures. It goes beyond previous systems in several respects. First, the model combines data-driven machine learning techniques and rule-based decision making to account for both inter-individual differences in gesture use, as well as patterns of form-meaning mappings specific to representation techniques. Second, the network accounts for the fact that the physical appearance of generated gestures is influenced by multiple factors: characteristic features of the referent accounting for iconicity, as well as contextual factors like the given communicative goal, information state, or previous gesture use. And third, learning gesture networks from individual speakers' data gives an easily interpretable visual image of preferences and strategies in composing gestures and makes them available to generate novel gesture forms in the style of the respective speaker. GNetIc models were brought to application in an overall architecture for integrated speech and gesture generation. Being equipped with proper knowledge sources, i.e., communicative plans, lexicon, grammar, propositional, and imagistic knowledge, a virtual agent was enabled to autonomously explain buildings of a virtual environment using speech and gestures. By switching between the respective decision networks, the system has the ability to simulate speaker-specific gesture use. Accounting for the two-fold rationale followed in this thesis, the GNetIc model was finally evaluated in two ways. First, in comparison with empirically observed gestural behavior, the model was shown to be able to successfully approximate human use of iconic gestures, especially when capturing the characteristics of individual speakers' gesture style. Second, when brought to application in a virtual agent, the generated gestural behavior was found to be positively rated by human recipients. In particular, individualized GNetIc-generated gestures could increase the perceived quality of object descriptions. Moreover, the virtual agent itself was rated more positively in terms of verbal capability, likeability, competence, and human-likeness.  Accordingly the results of this work provide first steps towards a more thorough understanding of iconic gesture production in humans and also on how gesture use may improve human-agent interaction.

Applied anatomical study of musculoperiosteal iliac branch of the ascending branch of lateral circumflex femoral artery

The Anterolateral Femoral Flap Using Bridge-Like Vascular Anastomosis for Coverage of Severe Damage Injury in Forearm

[Anatomic study and clinical application of iliac crest chimeric tissue flap]

Deep Circumflex Iliac Artery-vascularized Iliac Bone Graft for Femoral Head Osteonecrosis: Computed Tomography Anatomical Study

An Anatomical Study of Corona Mortis and Its Clinical Significance.

The production of co-speech iconic gestures: Empirical study and computational simulation with virtual agents

[Applied anatomical characteristics of vascularized iliac muscle flap and its clinical application in repairing oral and maxillofacial defects]

Applied Anatomy of the Lower Medial Leg Fascicutaneous Flap Pedicled with the Intermuscular Branch of the Posterior Tibial Artery and Its Dinical Significance

[Clinical application of iliac myocutaneous flap pedicled with deep circumflex iliac artery in repair of complex defect of lower limb with cavity]

EFFECT OF ILIAC BONE GRAFt WITH DEEP ILIAC CIRCUMFLEX VESSELS ON ISCHEMIC NECROSIS OF FEMO-RAL HEAD: A REPORT OF 54 CASES

Anatomical research of anterolateral thigh combined flap

[Preliminary application of foldable pedicled latissimus dorsi myocutaneous flap for repairing soft tissue defects in shoulder and back].

[Morphological study on the transverse branch of lateral femoral circumflex artery based on digital subtraction angiography]

Comparative Study of the Morphological Characteristics of Perforators of the Transverse and Descending Branches of the Lateral Circumflex Femoral Artery in Anterolateral Thigh Flap Surgery

Design and Clinical Applications of the Propeller Flaps Based on Perforators from Different Branches of the Lateral Circumflex Femoral Artery

Mapping of Marek's disease virus genome: Identification of junction sequences between unique and inverted repeat regions

Early Experience of Combined Anterolateral Thigh Flap and Ilioinguinal Flap in Patients with Severe Lower Extremity Trauma

Biomechanical research of medial femoral circumflex vascularized bone-grafting in the treatment of early-to-mid osteonecrosis of the femoral head: a finite element analysis

Clinical application of digital technology in the reconstruction of soft tissue defects of the lower extremity with free superficial circumflex iliac artery flap

[Effectiveness analysis of medial buttress plate augmented hollow lag screws fixation in combination with sartorius pedicled iliac flap for the treatment of femoral neck fractures in young adults]

Dengue-Immune Humans Have Higher Levels of Complement-Independent Enhancing Antibody than Complement-Dependent Neutralizing Antibody.