The Shadow: Coevolution Processes Between a Director, Actors and Avatars

Georges Gagneré

DOI: https://doi.org/10.1145/3632776.3632788

2024-05-14

Abstract:Andersen's tale The Shadow offers a theatrical situation confronting a Scholar to his Shadow. I program specific creatures that I called shadow avatar to stage the story with five of them and a physical narrator. Echoing Edmond Couchot's ideas about virtual people helping human beings to adapt to technological evolutions, I describe dynamics of coevolution characterizing the relationship between a director, actors, and shadow avatars during the process of staging The Shadow.

Computers and Society,Graphics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: how to explore and realize a new form of performing arts through the co - evolution process between virtual characters (shadow avatars) and real - life actors. Specifically, the author hopes to explore the dynamic relationships among directors, actors, and shadow avatars through the creation of the play "Shadow", and study the evolution of these relationships with the assistance of technology.

### Core Issues of the Paper

1. **Autonomy of Virtual Characters**:
- How can virtual characters (shadow avatars) be endowed with a certain degree of autonomy so that they can interact with human actors on the stage?
- Can these virtual characters exhibit human - like behaviors and emotions through technological means?

2. **Co - evolution Process**:
- How do directors, actors, and shadow avatars influence each other and co - evolve during the creation process?
- What impact do technological tools (such as motion capture, real - time animation, etc.) have on this co - evolution?

3. **Audience Experience**:
- How can mixed - reality technology be used to make the audience believe that shadow avatars are autonomously existing entities?
- Can this new form of performance change the audience's perception and experience of drama?

### Specific Methods and Technologies

- **Motion Capture and Real - time Animation**: Use motion - capture devices (mocaptor) to transmit actors' movements to virtual characters in real - time.
- **AvatarStaging Framework**: Combine hardware and software tools to achieve precise control and animation redirection of virtual characters in 3D space.
- **AKN_Regie Plug - in**: Develop an Unreal Engine plug - in for real - time control of virtual characters' movements and positions.
- **Salient - Idle Player (SIP)**: Through programming, decompose the movements of virtual characters so that each movement can be triggered at unfixed time points, enhancing the flexibility and autonomy of the performance.

### Goals and Significance

The author hopes to create a new form of drama through these technological means, which can not only show the interaction between virtual characters and human actors but also explore the possibility of human - machine coexistence. In addition, this new form of performance also aims to trigger the audience's thinking about virtual existence and human identity.

In summary, this paper attempts to explore the co - evolution process between virtual characters and human actors through the creation of the play "Shadow", and how this co - evolution is realized by technological means and affects the audience's experience.