Immersive Experiences and XR: A Game Engine or Multimedia Streaming Problem?

Simon N. B. Gunkel,Emmanouil Potetsianakis,Tessa E. Klunder,Alexander Toet,Sylvie S. Dijkstra-Soudarissanane
DOI: https://doi.org/10.5594/jmi.2023.3269752
2023-06-10
SMPTE Motion Imaging Journal
Abstract:Recent improvements in extended reality (XR) technology created an increase in XR products and solutions in the industry while raising new requirements for new or improved architectural concepts. This need can be particularly complex as XR applications often relate both to 3D geometric rendering and multimedia paradigms. This article outlines the main concepts relevant to XR, both from a game engineering and a multimedia streaming system perspective. XR requires new metadata and media/game orchestration to allow complex interaction between users, objects, and (volumetric) multimedia content, which also results in new requirements on synchronization (i.e., for global object state and positioning). Furthermore, the article presents the functional blocks needed in new XR system architectures and how they will glue both (game and media) spaces together. The discussion of functional components and architecture relates to the ongoing activities in relevant standardization bodies like Khronos, Moving Picture Experts Group (MPEG) and The 3rd Generation Partnership Project (3GPP). To make XR successful in the long term, the industry needs to agree on interoperable solutions and how to merge both game and media paradigms to allow complex multiuser XR applications.
What problem does this paper attempt to address?