Abstract:Millimeter-wave (mmWave) and terahertz (THz) communication systems require large antenna arrays and use narrow directive beams to ensure sufficient receive signal power. However, selecting the optimal beams for these large antenna arrays incurs a significant beam training overhead, making it challenging to support applications involving high mobility. In recent years, machine learning (ML) solutions have shown promising results in reducing the beam training overhead by utilizing various sensing modalities such as GPS position and RGB images. However, the existing approaches are mainly limited to scenarios with only a single object of interest present in the wireless environment and focus only on co-located sensing, where all the sensors are installed at the communication terminal. This brings key challenges such as the limited sensing coverage compared to the coverage of the communication system and the difficulty in handling non-line-of-sight scenarios. To overcome these limitations, our paper proposes the deployment of multiple distributed sensing nodes, each equipped with an RGB camera. These nodes focus on extracting environmental semantics from the captured RGB images. The semantic data, rather than the raw images, are then transmitted to the basestation. This strategy significantly alleviates the overhead associated with the data storage and transmission of the raw images. Furthermore, semantic communication enhances the system's adaptability and responsiveness to dynamic environments, allowing for prioritization and transmission of contextually relevant information. Experimental results on the DeepSense 6G dataset demonstrate the effectiveness of the proposed solution in reducing the sensing data transmission overhead while accurately predicting the optimal beams in realistic communication environments.

Semantic Communication for Remote Spectrum Sensing in Non-Terrestrial Networks

Perceptive Mobile Networks for Unmanned Aerial Vehicle Surveillance: from the Perspective of Cooperative Sensing

Perceptive Mobile Networks for Standalone and Cooperative UAV Surveillance

5G Spectrum Learning-Based Passive UAV Detection in Urban Scenario.

Covert UAV Data Transmission Via Semantic Communication: A DRL-Driven Joint Position and Power Optimization Method

Collaborative Wideband Spectrum Sensing and Scheduling for Networked UAVs in UTM Systems

SATSense: Multi-Satellite Collaborative Framework for Spectrum Sensing

Secure Design for Integrated Sensing and Semantic Communication System

Federated Learning-based Collaborative Wideband Spectrum Sensing and Scheduling for UAVs in UTM Systems

Multimodal Virtual Semantic Communication for Tiny-Machine-Learning-Based UAV Task Execution

Sensing, Communication, and Control Co-design for Energy Efficient Satellite-UAV Networks

Federated Learning for UAV-Based Spectrum Sensing: Enhancing Accuracy Through SNR-Weighted Model Aggregation

Lyapunov-guided Deep Reinforcement Learning for Semantic-aware AoI Minimization in UAV-assisted Wireless Networks

Semantic-Aware Vision-Assisted Integrated Sensing and Communication: Architecture and Resource Allocation

UAV-assisted Semantic Communication with Hybrid Action Reinforcement Learning

Adaptive Resource Allocation for Semantic Communication Networks

Environment Semantic Communication: Enabling Distributed Sensing Aided Networks

Dual-Functional UAV-Empowered Space-Air-Ground Networks: Joint Communication and Sensing

Toward Seamless Localization and Communication: A Satellite-UAV NTN Architecture

Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learning

Task-Oriented Image Transmission for Scene Classification in Unmanned Aerial Systems