Abstract:This article introduces an approach to harness digital twin (DT) technology in the realm of integrated sensing and communications (ISACs) in sixth-generation (6G) Internet of Everything (IoE) applications. We consider moving targets in a vehicular network and use DT to track and predict the motion of the vehicles. After predicting the location of the vehicle at the next time slot, the DT designs the assignment and beamforming for each vehicle. The real-time sensing information is then utilized to update and refine the DT, enabling further processing and decision making. In the DT, an extended Kalman filter (EKF) is used for the precise motion prediction. This model incorporates a dynamic Kalman gain, which is updated at each time slot based on the received echo signals. The state representation encompasses both the vehicle motion information and the error matrix, with the posterior Cram & eacute;r-Rao bound (PCRB) employed to assess sensing accuracy. We consider a network with two roadside units (RSUs), and the vehicles need to be allocated to one of them. To optimize the overall transmission rate while maintaining acceptable sensing accuracy, an optimization problem is formulated. Since, it is generally hard to solve the original problem, the Lagrange multipliers and fractional programming are employed to simplify this optimization problem. To solve the simplified problem, this article introduces both the greedy and heuristic algorithms by optimizing both the vehicle assignments and predictive beamforming. The optimized results are then transferred back to the real space for ISAC applications. Recognizing the computational complexity of the greedy and heuristic algorithms, a bidirectional long short-term memory (LSTM)-based recurrent neural network (RNN) is proposed for efficient beamforming design within the DT. Simulation results demonstrate the effectiveness of the DT-based ISAC network. Notably, the LSTM-based RNN method achieves similar transmission rates as the heuristic algorithm but with significantly reduced computational complexity.

3-D LiDAR and GPS Aided Beam Tracking in Millimeter Wave Vehicular Communications

Multi-modal fusion for sensing-aided beam tracking in mmWave communications

Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstration

Predictive Beam Tracking with Cooperative Sensing for Vehicle-to-Infrastructure Communications.

Deep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Network

Millimeter Wave V2V Beam Tracking using Radar: Algorithms and Real-World Demonstration

Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios

Sensing-Assisted Beam Tracking in V2I Networks: Extended Target Case

Multimodal Deep Learning Empowered Millimeter-Wave Beam Prediction

Machine Learning-Based mmWave MIMO Beam Tracking in V2I Scenarios: Algorithms and Datasets

Fast Channel Estimation and Beam Tracking for Millimeter Wave Vehicular Communications

Integrated Sensing and Communications for V2I Networks: Dynamic Predictive Beamforming for Extended Vehicle Targets

LIDAR Data for Deep Learning-Based mmWave Beam-Selection

Radar Aided mmWave Vehicle-to-InfrastructureLink Configuration Using Deep Learning

Joint Vehicle Connection and Beamforming Optimziation in Digital Twin Assisted Integrated Sensing and Communication Vehicular Networks

Vision-aided Multi-user Beam Tracking for Mmwave Massive MIMO System: Prototyping and Experimental Results

Machine Learning Enabling Analog Beam Selection for Concurrent Transmissions in Millimeter-Wave V2V Communications

Integrated Sensing and Communications Towards Proactive Beamforming in mmWave V2I via Multi-Modal Feature Fusion (MMFF)

Vision-Position Multi-Modal Beam Prediction Using Real Millimeter Wave Datasets

Beamforming and Scalable Image Processing in Vehicle-to-Vehicle Networks

Deep learning-based beam alignment in mmWave vehicular networks