Abstract:In this paper a novel joint sensing, communication, and artificial intelligence (AI) framework is proposed so as to optimize extended reality (XR) experiences over terahertz (THz) wireless systems. The proposed framework consists of three main components. First, a tensor decomposition framework is proposed to extract unique sensing parameters for XR users and their environment by exploiting then THz channel sparsity. Essentially, THz band's quasi-opticality is exploited and the sensing parameters are extracted from the uplink communication signal, thereby allowing for the use of the same waveform, spectrum, and hardware for both communication and sensing functionalities. Then, the Cramer-Rao lower bound is derived to assess the accuracy of the estimated sensing parameters. Second, a non-autoregressive multi-resolution generative artificial intelligence (AI) framework integrated with an adversarial transformer is proposed to predict missing and future sensing information. The proposed framework offers robust and comprehensive historical sensing information and anticipatory forecasts of future environmental changes, which are generalizable to fluctuations in both known and unforeseen user behaviors and environmental conditions. Third, a multi-agent deep recurrent hysteretic Q-neural network is developed to control the handover policy of reconfigurable intelligent surface (RIS) subarrays, leveraging the informative nature of sensing information to minimize handover cost, maximize the individual quality of personal experiences (QoPEs), and improve the robustness and resilience of THz links. Simulation results show a high generalizability of the proposed unsupervised generative AI framework to fluctuations in user behavior and velocity, leading to a 61 % improvement in instantaneous reliability compared to schemes with known channel state information.

Networked Integration of Sensing and Communication for Extended Reality: Framework, Challenges and Solutions

Integrated Communication, Sensing, and Computation Framework for 6G Networks

Integrated Sensing and Communication: A Network Level Perspective

Semantic Sensing and Communications for Ultimate Extended Reality

Joint Multi-User Communication and Sensing Exploiting Both Signal and Environment Sparsity

Intelligent Surface Enabled Sensing-Assisted Communication

Multi-View Sensing for Wireless Communications: Architectures, Designs, and Opportunities

Streamlined Transmission: A Semantic-Aware XR Deployment Framework Enhanced by Generative AI

Joint Sensing, Communication, and AI: A Trifecta for Resilient THz User Experiences

Integrated Sensing and Communications Framework for 6G Networks

Practical Issues and Challenges in CSI-based Integrated Sensing and Communication

Reconfigurable Intelligent Surface for Sensing, Communication, and Computation: Perspectives, Challenges, and Opportunities

Near-field Integrated Sensing and Communication: Opportunities and Challenges

Towards ISAC-Empowered Vehicular Networks: Framework, Advances, and Opportunities

An XRI Mixed-Reality Internet-of-Things Architectural Framework Toward Immersive and Adaptive Smart Environments

A Survey on Integrated Sensing, Communication, and Computation

Networked Integrated Sensing and Communications for 6G Wireless Systems

Integrated Sensing, Computation, and Communication: System Framework and Performance Optimization

Integrated Sensing and Communications: Recent Advances and Ten Open Challenges

Converged Reconfigurable Intelligent Surface and Mobile Edge Computing for Space Information Networks