An XRI Mixed-Reality Internet-of-Things Architectural Framework Toward Immersive and Adaptive Smart Environments

Alexis Morris,Jie Guan,Amna Azhar

DOI: https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00024

2023-06-02

Abstract:The internet-of-things (IoT) refers to the growing number of embedded interconnected devices within everyday ubiquitous objects and environments, especially their networks, edge controllers, data gathering and management, sharing, and contextual analysis capabilities. However, the IoT suffers from inherent limitations in terms of human-computer interaction. In this landscape, there is a need for interfaces that have the potential to translate the IoT more solidly into the foreground of everyday smart environments, where its users are multimodal, multifaceted, and where new forms of presentation, adaptation, and immersion are essential. This work highlights the synergetic opportunities for both IoT and XR to converge toward hybrid XR objects with strong real-world connectivity, and IoT objects with rich XR interfaces. The paper contributes i) an understanding of this multi-disciplinary domain XR-IoT (XRI); ii) a theoretical perspective on how to design XRI agents based on the literature; iii) a system design architectural framework for XRI smart environment development; and iv) an early discussion of this process. It is hoped that this research enables future researchers in both communities to better understand and deploy hybrid smart XRI environments.

Human-Computer Interaction

What problem does this paper attempt to address?

The paper attempts to address the limitations of current Internet of Things (IoT) systems in terms of human-computer interaction. Specifically, existing IoT interfaces primarily rely on 2D panel displays on devices, dashboard displays on remote mobile devices or cloud platforms, and voice command interfaces such as Amazon's Alexa, Google's Assistant, or Apple's Siri. These interface designs have significant limitations in terms of accuracy, privacy protection, clarity of information display, and interactivity. Especially as the system scales up, maintaining an effective overview of the IoT intelligent system becomes a major challenge. To address these issues, the paper proposes a new framework that combines Mixed Reality (MR) with IoT—the XR-IoT (XRI) architecture framework, aiming to create a more immersive and adaptive intelligent environment. Through this integration, not only can it provide rich visual interfaces that break spatial limitations, but it can also achieve information inspection and interaction through non-traditional feedback mechanisms, fundamentally transforming IoT from a passive background to an active and engaging foreground information infrastructure. The paper also explores the role of Artificial Intelligence (AI) as a third important factor in this interdisciplinary integration, particularly in terms of perception understanding and contextual awareness, as well as the importance of agent system controllers and multi-agent design. The goal of the paper is to provide future researchers with a theoretical perspective and system design architecture framework to better understand and deploy mixed intelligent XRI environments.

An XRI Mixed-Reality Internet-of-Things Architectural Framework Toward Immersive and Adaptive Smart Environments

Extended-XRI Body Interfaces for Hyper-Connected Metaverse Environments

Design Frameworks for Spatial Zone Agents in XRI Metaverse Smart Environments

Design Frameworks for Hyper-Connected Social XRI Immersive Metaverse Environments

Toward Mixed Reality Hybrid Objects with IoT Avatar Agents

Cross-Reality for Extending the Metaverse: Designing Hyper-Connected Immersive Environments with XRI

Extending the Metaverse: Hyper-Connected Smart Environments with Mixed Reality and the Internet of Things

Design of an XR Collab. Arch. for Mixed Immersive and MS Interaction

Extended Reality and Internet of Things for Hyper-Connected Metaverse Environments

An XR rapid prototyping framework for interoperability across the reality spectrum

Creating the Internet of Augmented Things: An Open-Source Framework to Make IoT Devices and Augmented and Mixed Reality Systems Talk to Each Other

Exploring Extended Reality with ILLIXR: A New Playground for Architecture Research

Augmented Object Intelligence with XR-Objects

Toward the Internet of No Things: The Role of O2O Communications and Extended Reality

XR-Ed Framework: Designing Instruction-driven andLearner-centered Extended Reality Systems for Education

Explainable AI over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directions

Streamlined Transmission: A Semantic-Aware XR Deployment Framework Enhanced by Generative AI

Towards the Internet of X-things: New Possibilities for Underwater, Underground, and Outer Space Exploration

When Internet of Things meets Metaverse: Convergence of Physical and Cyber Worlds

What is XR? Towards a Framework for Augmented and Virtual Reality

A Security Framework for the Internet of Things in the Future Internet Architecture