Abstract:Digital twins are an important technology for advancing mobile communications, specially in use cases that require simultaneously simulating the wireless channel, 3D scenes and machine learning. Aiming at providing a solution to this demand, this work describes a modular co-simulation methodology called CAVIAR. Here, CAVIAR is upgraded to support a message passing library and enable the virtual counterpart of a digital twin system using different 6G-related simulators. The main contributions of this work are the detailed description of different CAVIAR architectures, the implementation of this methodology to assess a 6G use case of UAV-based search and rescue mission (SAR), and the generation of benchmarking data about the computational resource usage. For executing the SAR co-simulation we adopt five open-source solutions: the physical and link level network simulator Sionna, the simulator for autonomous vehicles AirSim, scikit-learn for training a decision tree for MIMO beam selection, Yolov8 for the detection of rescue targets and NATS for message passing. Results for the implemented SAR use case suggest that the methodology can run in a single machine, with the main demanded resources being the CPU processing and the GPU memory.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to achieve co - simulation of wireless communication, 3D scenes and artificial intelligence (AI) through digital twin technology (Digital Twins, DTs) in 5G/6G communication networks. Specifically, the paper proposes a modular co - simulation methodology named CA VIAR (Communication Networks, Artificial Intelligence and Computer Vision with 3D Computer - generated Imagery), aiming to support the following requirements: 1. **Co - simulation of communication, 3D CGI and AI/ML**: CA VIAR needs to be able to simultaneously simulate wireless communication channels, 3D scenes and machine - learning models, especially when these models can affect the trajectories of moving objects in real - time. For example, in unmanned aerial vehicle search and rescue (SAR) tasks, the wireless channel cannot be pre - calculated but is dynamically generated during the simulation process according to the position of the unmanned aerial vehicle. 2. **High - resolution 3D representation**: CA VIAR supports the use of modern 3D engines (such as Unreal Engine and Unity3D) to generate realistic 3D scenes to meet the need for high - resolution representation of the physical world. 3. **Ray - tracing - based communication channel generation**: CA VIAR supports the use of ray - tracing methods to generate communication channels at specific locations, which is more accurate than traditional random or hybrid channel models, especially when considering mobility. 4. **Reasonable computational cost**: The goal of CA VIAR's design is to run simulations on high - performance personal computers, and when the total simulation time (Tv) is 60 seconds, the actual running time (Tp) does not exceed 1 hour. 5. **Modularity**: CA VIAR supports the flexible integration of different simulators and does not depend on specific software, which is convenient for maintenance and customization. For example, the network simulator in the communication module can be easily replaced from ns - 3 to OMNeT++. To verify these requirements, the paper describes different architectures of CA VIAR and implements a SAR case for evaluating 6G applications. In addition, the paper also provides benchmark test data, proving the feasibility of this method on a single machine, with the main resource consumption being CPU processing power and GPU memory. Through these contributions, CA VIAR provides a powerful tool for the development of 5G/6G digital twin systems.

CAVIAR: Co-simulation of 6G Communications, 3D Scenarios and AI for Digital Twins

A System-Level Simulation Module for Multi-UAV IRS-assisted Communications

Digital twin modelling of open category UAV radio communications: A case study

Digital Twins and Testbeds for Supporting AI Research with Autonomous Vehicle Networks

A Multi-Modal Simulation Framework to Enable Digital Twin-based V2X Communications in Dynamic Environments

Advancing Experimental Platforms for UAV Communications: Insights from AERPAW'S Digital Twin

Multiverse at the Edge: Interacting Real World and Digital Twins for Wireless Beamforming

Vision-Assisted Digital Twin Creation for mmWave Beam Management

Astralis: A High-Fidelity Simulator for Heterogeneous Robot and Human-Robot Teaming

Causal Semantic Communication for Digital Twins: A Generalizable Imitation Learning Approach

Cesium Tiles for High-realism Simulation and Comparing SLAM Results in Corresponding Virtual and Real-world Environments

Internet of Drones Simulator: Design, Implementation, and Performance Evaluation

Toward Real-Time Digital Twins of EM Environments: Computational Benchmark of Ray Launching Software

Lightweight Simulation of Hybrid Aerial- and Ground-based Vehicular Communication Networks

Colosseum as a Digital Twin: Bridging Real-World Experimentation and Wireless Network Emulation

Real-World Data Inspired Interactive Connected Traffic Scenario Generation

An Advanced Framework for Ultra-Realistic Simulation and Digital Twinning for Autonomous Vehicles

A Calibrated and Automated Simulator for Innovations in 5G

CAVSim: A Microscopic Traffic Simulator for Evaluation of Connected and Automated Vehicles

An Aerodynamic, Computer Vision, and Network Simulator for Networked Drone Applications.