AKN_Regie: bridging digital and performing arts

Georges Gagneré,Anastasiia Ternova

DOI: https://doi.org/10.1145/3623462.3624636

2024-01-08

Abstract:AvatarStaging framework consists in directing avatars on a mixed theatrical stage, enabling a co-presence between the materiality of the physical actor and the virtuality of avatars controlled in real time by motion capture or specific animation players. It led to the implementation of the AKN_Regie authoring tool, programmed with the Blueprint visual language as a plugin for the Unreal Engine (UE) video game engine. The paper describes AKN_Regie main functionalities as a tool for non-programmer theatrical people. It gives insights of its implementation in the Blueprint visual language specific to UE. It details how the tool evolved along with its use in around ten theater productions. A circulation process between a nonprogramming point of view on AKN_Regie called Plugin Perspective and a programming acculturation to its development called Blueprint Perspective is discussed. Finally, a C++ Perspective is suggested to enhance the cultural appropriation of technological issues, bridging the gap between performing arts deeply involved in human materiality and avatars inviting to discover new worlds.

Graphics

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is, in the context of the integration of digital art and performing art, how to promote the use and understanding of digital technology by non - programmer theater technicians and artists through technical tools. Specifically, the paper introduces **AKN_Regie**, an authoring tool developed as a plugin for the Unreal Engine (UE) game engine, aiming to achieve real - time manipulation of virtual characters (i.e., avatars) on a mixed - reality stage. It solves the above - mentioned problems in the following ways:

1. **Providing a user - friendly interface**: AKN_Regie uses the Blueprint visual programming language, enabling technical managers and artists without a programming background to easily get started and achieve real - time control of virtual characters without in - depth knowledge of complex programming.

2. **Supporting real - time interaction**: This tool allows users to control virtual characters in real - time through motion - capture devices or specific animation players, thus achieving co - existence on a mixed - reality stage, that is, the interaction between physical actors and virtual characters.

3. **Adapting to the needs of different projects**: With the application of the tool in about 10 theater works, AKN_Regie has continuously evolved to adapt to different creative needs and technical challenges, demonstrating its flexibility and adaptability.

4. **Promoting interdisciplinary cooperation**: The paper also discusses the adaptation process from a non - programming perspective (Plugin Perspective) to a programming culture (Blueprint Perspective), and proposes the possibility of further enhancing the cultural adaptability of technical problems from a C++ perspective, aiming to bridge the gap between the performing arts deeply rooted in human materiality and virtual characters that invite exploration of new worlds.

Through these functions and features, the AKN_Regie tool not only promotes the integration of digital technology and performing art but also provides powerful technical support for non - programmer users, enabling them to better utilize digital technology for artistic creation.