Colosseum as a Digital Twin: Bridging Real-World Experimentation and Wireless Network Emulation

Davide Villa,Miead Tehrani-Moayyed,Clifton Paul Robinson,Leonardo Bonati,Pedram Johari,Michele Polese,Tommaso Melodia
2024-01-24
Abstract:Wireless network emulators are being increasingly used for developing and evaluating new solutions for Next Generation (NextG) wireless networks. However, the reliability of the solutions tested on emulation platforms heavily depends on the precision of the emulation process, model design, and parameter settings. To address, obviate, or minimize the impact of errors of emulation models, in this work, we apply the concept of Digital Twin (DT) to large-scale wireless systems. Specifically, we demonstrate the use of Colosseum, the world's largest wireless network emulator with hardware-in-the-loop, as a DT for NextG experimental wireless research at scale. As proof of concept, we leverage the Channel emulation scenario generator and Sounder Toolchain (CaST) to create the DT of a publicly available over-the-air indoor testbed for sub-6 GHz research, namely, Arena. Then, we validate the Colosseum DT through experimental campaigns on emulated wireless environments, including scenarios concerning cellular networks and jamming of Wi-Fi nodes, on both the real and digital systems. Our experiments show that the DT is able to provide a faithful representation of the real-world setup, obtaining an average similarity of up to 0.987 in throughput and 0.982 in Signal to Interference plus Noise Ratio (SINR).
Networking and Internet Architecture,Signal Processing
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper primarily aims to address the reliability issues of simulation platforms encountered during the development and testing of next-generation (NextG) wireless networks. Specifically, the paper achieves this goal through the following points: 1. **Proposing the Concept of Digital Twin**: Applying the concept of Digital Twin (DT) to large-scale wireless systems to reduce or eliminate the impact of errors in simulation models. The paper demonstrates how to use Colosseum—the world's largest hardware-in-the-loop wireless network emulator—as a digital twin platform for large-scale experimental wireless research. 2. **Validating the Digital Twin Platform**: Creating a digital twin of the publicly available indoor wireless testbed Arena using the Channel Emulation Scenario Generator and Sounder Toolchain (CaST), and validating the accuracy of this digital twin platform through a series of experiments. These experiments include wireless environment simulations on both real and digital systems, involving scenarios such as cellular network and Wi-Fi node interference. 3. **Evaluating Performance Metrics**: Comparing key network performance metrics (such as throughput and Signal-to-Interference-plus-Noise Ratio, SINR) of the Arena/Colosseum digital twin to verify the fidelity of its simulations. The results show that when using the cellular protocol stack, the average normalized cross-correlation similarity of throughput reaches 0.987, and SINR reaches 0.982. Through the above work, the paper demonstrates the capability of Colosseum as a digital twin platform and provides the research community with a set of tools to create and validate real-world wireless environments. This enables researchers to conduct wireless experiments in high-fidelity simulation environments, develop and test new algorithms, and obtain results as close to real-world conditions as possible.