Design Frameworks for Spatial Zone Agents in XRI Metaverse Smart Environments

Jie Guan,Jiamin Liu,Alexis Morris

2024-01-20

Abstract:The spatial XR-IoT (XRI) Zone Agents concept combines Extended Reality (XR), the Internet of Things (IoT), and spatial computing concepts to create hyper-connected spaces for metaverse applications; envisioning space as zones that are social, smart, scalable, expressive, and agent-based. These zone agents serve as applications and agents (partners, assistants, or guides) for users co-living and co-operating together in a shared spatial context. The zone agent concept is toward reducing the gap between the physical environment (space) and the classical two-dimensional user interface, through space-based interactions for future metaverse applications. This integration aims to enrich user engagement with their environments through intuitive and immersive experiences and pave the way for innovative human-machine interaction in smart spaces. Contributions include: i) a theoretical framework for creating XRI zone/space-agents using Mixed-Reality Agents (MiRAs) and XRI theory, ii) agent and scene design for spatial zone agents, and iii) prototype and user interaction design scenario concepts for human-to-space agent relationships in an early immersive smart-space application.

Human-Computer Interaction

What problem does this paper attempt to address?

This paper aims to solve how to design and implement a new type of Spatial Zone Agents to enhance the interactive experience between users and virtual reality (VR), augmented reality (AR), and mixed reality (MR) environments. Specifically, the paper attempts to create a highly - connected meta - universe environment by combining extended reality (XR), the Internet of Things (IoT), and spatial computing technologies, reducing the gap between the physical environment and the traditional two - dimensional user interface, thereby providing a more intuitive and immersive user experience.

The main contributions of the paper include:
1. **Theoretical Framework**: Propose a theoretical framework based on the Mixed Reality Agents (MiRAs) theory and the XRI (XR - IoT) concept for creating Spatial Zone Agents.
2. **Agent and Scene Design**: Describe in detail the design method of Spatial Zone Agents, including their applications in different scenarios.
3. **Prototype and User Interaction Design**: Present an early prototype of Spatial Zone Agents and its user - interaction design concept, especially in the laboratory environment.

Through these contributions, the paper hopes to provide new ideas and methods for human - computer interaction in future meta - universe environments, enabling digital twin environments to work better in synergy with human users and enhancing users' participation and immersion.