Challenges of movement quality using motion capture in theatre

Georges Gagneré,Andy Lavender,Cédric Plessiet,Tim White

DOI: https://doi.org/10.1145/3212721.3212883

2023-03-13

Abstract:We describe1 two case studies of AvatarStaging theatrical mixed reality framework combining avatars and performers acting in an artistic context. We outline a qualitative approach toward the condition for stage presence for the avatars. We describe the motion control solutions we experimented with from the perspective of building a protocol of avatar direction in a mixed reality appropriate to live performance.

Graphics

What problem does this paper attempt to address?

This paper attempts to solve the problem of how to ensure the motion quality of virtual characters (avatars) and the coordination of interaction with real actors when using motion - capture technology in theater performances. Specifically, the research focuses on the following aspects:

1. **Virtual Character Control in the Mixed - Reality Framework**:
The paper describes two case studies, exploring the mixed - reality framework (AvatarStaging) that combines virtual characters and performers, aiming to establish a virtual - character - guiding protocol suitable for live performances. The author experiments with different motion - control solutions to achieve high - quality stage performances.

2. **The Realism and Interactivity of Virtual Characters**:
Even if virtual characters are controlled by humans, the authenticity of their presence remains a problem. Therefore, new methods need to be developed to adjust the interaction and ensure the coordination between the motion quality of virtual characters and real actors. This involves the meticulous regulation of the behavior of virtual characters in mixed reality.

3. **Application Challenges of Motion - Capture Technology**:
The application of motion - capture technology in theaters faces many challenges, especially in maintaining the fluency and naturalness of virtual - character motions. The study mentions that there needs to be close cooperation between mocaptor (actors wearing motion - capture devices) and manipulactor (operators using gamepads to control the positions of virtual characters) to ensure that the motions of virtual characters meet expectations and can respond to the needs of performers in real time.

4. **New Interaction Modes in Performing Arts**:
The combination of traditional performing - art forms and digital technology has brought new performance modes and interaction methods. The research explores how to enhance the performance effect through virtual characters in this mixed reality and raises performance issues regarding the "second body" (i.e., virtual characters).

5. **Specific Practices in Case Studies**:
The paper shows the settings and operation methods in different scenarios through two specific case studies (Configuration 1 and Configuration 2). These case studies not only demonstrate the details of technical implementation but also explore the challenges and solutions in actual operations, such as how to achieve complex motion sequences in a limited space and how to optimize the performance effect through visual feedback.

### Summary

The main objective of this paper is to explore and solve the problem of ensuring the motion quality of virtual characters and their coordinated interaction with real actors when using motion - capture technology in theater performances. By introducing the mixed - reality framework and detailed motion - control solutions, the research aims to provide theoretical and technical support for similar performances in the future.