Abstract:The paper explores interactive storytelling in Augmented and Virtual Reality. It is based on the project ANONYMIZED that bridges the gap between technological developments and their application and aims to combine art, economy and science. Five use cases employ an interdisciplinary research design in the areas of Creative Media, Smart Manufacturing and Healthcare. They all develop prototypical applications but also attend to their contextualization with focus on narrative elements: Each use case defines a ”story” in its own context, the purpose of its narration, and its media specificity. Due to their increased availability, virtual and immersive technologies have not only led to a resurgence of their popularity but also to intriguing new perspectives regarding their use in different contexts. Our research project employs state-of-the art AR and VR technology in five use cases about VR Interaction, Motion Tracking in Artistic VR, Auditory AR for Industry, AR Interfaces for Industry and AR Education for Patients. All of them inquire prototypical applications but relate to the central concept of interactive storytelling. The project addresses three distinct dimensions of storytelling in each use case: the production of a coherent story, the collection and transfer of knowledge, and the specificity of the used technology. Those dimensions are widely known and employed. However, they are seldomly intertwined in one interdisciplinary project focusing on immersive media. Furthermore, the notions of interactivity and immersion play significant roles in the study of storytelling in conjunction with VR an AR. Following papers about immersive storytelling are significant: John Bucher (2017) e. g. examines the timeless principles of storytelling and how they are applied, transformed, and transcended in VR. Marie-Laure Ryan (2015) combines the concepts of immersion and interactive storytelling into a Poetics of Immersion including spatial, temporal and emotional categories. She highlights underlying interactive structures such as the Complete Graph, the Network, the Flowchart. Moya Baldry (2018) discusses the role of the author in complex narratives of immersive environments. Covering the areas of Creative Media, Smart Manufacturing and Healthcare leads to a very specific research design, as each area is connected to different research contexts. Therefore, the paper focuses on the above-mentioned dimensions of storytelling and addresses the following questions: How is the “story” defined in each context and what is its purpose? Which methods and technologies are used to convey it? Which narrative elements show potential and how can they be developed further for future applications? The paper reflects on the outcome of the use cases and potential future applications of interactive storytelling in immersive media.

Virtual Human: Storytelling and Computer Graphics for a Virtual Human Platform

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

Exploitation Of Novel Multiplayer Gesture-Based Interaction And Virtual Puppetry For Digital Storytelling To Develop Children'S Narrative Skills

Study on Virtual Human for Art and Design

Interactive Animation of Virtual Characters: Application to Virtual Kung-Fu Fighting

Immersive Storytelling in Creative Media, Smart Manufacturing and Healthcare

Interactive Storytelling for Immersive Media, Augmented Manufacturing, and Digital Healthcare

Balanced Virtual Humans Interacting with their Environment

Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter Explaining 2D-Presented Information

Natural Virtual Reality User Interface to Define Assembly Sequences for Digital Human Models

Implementation of the Interactive Gestures of Virtual Avatar Based on a Multi-user Virtual Learning Environment

Designing a Virtual Manikin Animation Framework Aimed at Virtual Prototyping

Crafting Realistic Virtual Humans: Unveiling Perspectives on Human Perception, Crowds, and Embodied Conversational Agents

Towards the Holodeck: Fully Immersive Virtual Reality Visualisation of Scientific and Engineering Data

Virtual Reality Conferencing

Talking Realities: Audio Guides in Virtual Reality Visualizations

Visual Feedback for Grasping in Virtual Reality Environments for an Interface to Instruct Digital Human Models

Perceptual Analysis of Groups of Virtual Humans Animated using Interactive Platforms

Interconnected virtual space and Theater. Practice as research on theater stage in the era of the network

Emotional Storytelling Using Virtual and Robotic Agents

Virtual Character Animation Based on Affordable Motion Capture and Reconfigurable Tangible Interfaces