Bridging the Gap between Individuality and Joint Improvisation in the Mirror Game

Chao Zhai,Michael Z. Q. Chen,Francesco Alderisio,Alexei Yu. Uteshev,Mario di Bernardo

DOI: https://doi.org/10.48550/arXiv.1611.05443

2016-11-16

Abstract:Extensive experiments in Human Movement Science suggest that solo motions are characterized by unique features that define the individuality or motor signature of people. While interacting with others, humans tend to spontaneously coordinate their movement and unconsciously give rise to joint improvisation. However, it has yet to be shed light on the relationship between individuality and joint improvisation. By means of an ad-hoc virtual agent, in this work we uncover the internal mechanisms of the transition from solo to joint improvised motion in the mirror game, a simple yet effective paradigm for studying interpersonal human coordination. According to the analysis of experimental data, normalized segments of velocity in solo motion are regarded as individual motor signature, and the existence of velocity segments possessing a prescribed signature is theoretically guaranteed. In this work, we first develop a systematic approach based on velocity segments to generate \emph{in-silico} trajectories of a given human participant playing solo. Then we present an online algorithm for the virtual player to produce joint improvised motion with another agent while exhibiting some desired kinematic characteristics, and to account for movement coordination and mutual adaptation during joint action tasks. Finally, we demonstrate that the proposed approach succeeds in revealing the kinematic features transition from solo to joint improvised motions, thus revealing the existence of a tight relationship between individuality and joint improvisation.

Neurons and Cognition

What problem does this paper attempt to address?

This paper attempts to address the issue of revealing the relationship between individuality and joint improvisation in mirror games. Specifically, the authors designed a Virtual Player (VP) to study the internal mechanisms from individual solo movements to joint improvisational movements with others. The main goal of the paper is to develop a computational architecture that enables the virtual agent to interact and coordinate effectively with human participants while maintaining specific movement characteristics (i.e., individual movement signatures).

### Background of the Paper
- **Individuality**: Experimental studies have shown that each person's solo movements have unique characteristics that define their individual movement signature.
- **Joint Improvisation**: When people interact with others, they spontaneously coordinate their movements and unconsciously generate joint improvisation.
- **Core Issue**: The relationship between individuality and joint improvisation is currently unclear.

### Research Methods
1. **Experimental Design**:
- **Mirror Game**: A simple yet effective paradigm for studying interpersonal coordination and interaction.
- **Experimental Conditions**:
- **Solo Condition**: Participants play the game alone, attempting to create interesting movements.
- **Leader-Follower Condition**: One participant leads the game while the other follows.
- **Joint Improvisation Condition**: Two participants imitate each other, creating synchronized and interesting movements without designated leaders or followers.

2. **Computational Architecture**:
- **Generating Solo Movements**: Using a velocity segment-based approach to generate solo trajectories with specific movement characteristics.
- **Online Algorithm**: Enabling the virtual agent to produce joint improvisational movements while interacting with human participants or other virtual agents, maintaining movement coordination and mutual adaptation.

### Main Contributions
- **Mathematical Model**: Developed a mathematical model that allows the virtual agent to engage in joint improvisation with human participants in mirror games while maintaining predetermined movement signatures.
- **Computational Architecture**: Proposed a computational architecture capable of generating solo trajectories with specific movement characteristics and producing joint improvisational movements during interactions.
- **Experimental Validation**: Validated the effectiveness of the proposed computational architecture through experimental data, demonstrating that the virtual agent can successfully replicate human participants' movement signatures and exhibit good coordination in joint improvisation.

### Conclusion
Through experimental and theoretical analysis, the paper reveals the close relationship between individuality and joint improvisation, providing new insights into understanding interpersonal coordination and interaction. This research not only contributes to the development of social psychology and movement science but also provides a theoretical foundation for developing more intelligent virtual agents and robots.