Data Integration Framework for Virtual Reality Enabled Digital Twins

Florian Stadtmann,Hary Pirajan Mahalingam,Adil Rasheed

2024-01-04

Abstract:Digital twins are becoming increasingly popular across many industries for real-time data streaming, processing, and visualization. They allow stakeholders to monitor, diagnose, and optimize assets. Emerging technologies used for immersive visualization, such as virtual reality, open many new possibilities for intuitive access and monitoring of remote assets through digital twins. This is specifically relevant for floating wind farms, where access is often limited. However, the integration of data from multiple sources and access through different devices including virtual reality headsets can be challenging. In this work, a data integration framework for static and real-time data from various sources on the assets and their environment is presented that allows collecting and processing of data in Python and deploying the data in real-time through Unity on different devices, including virtual reality headsets. The integration of data from terrain, weather, and asset geometry is explained in detail. A real-time data stream from the asset to the clients is implemented and reviewed, and instructions are given on the code required to connect Python scripts to any Unity application across devices. The data integration framework is implemented for a digital twin of a floating wind turbine and an onshore wind farm, and the potential for future research is discussed.

Signal Processing

What problem does this paper attempt to address?

This paper proposes a solution to the problem of integrating digital twin datasets supported by virtual reality (VR). Digital twin is a real-time data streaming, processing, and visualization tool used for monitoring, diagnosing, and optimizing assets, especially in access-constrained floating wind farms. However, there are challenges in integrating data from multiple sources and accessing this data on different devices including VR headsets.

The paper introduces a framework that allows for the collection and processing of static and real-time data from various asset and environmental sources, deployed using Python, and enabling real-time transmission to different devices including VR headsets on Unity. The authors explain in detail the integration of terrain, weather, and asset geometry data, and implement real-time data streaming from assets to clients. They provide code instructions for connecting Python scripts to Unity applications across devices. The framework has been applied to digital twins of both floating and onshore wind turbines, discussing potential future research.

The paper focuses primarily on:
1. Design and implementation of a data integration framework to integrate data from different sources.
2. Use of Python server for data processing and real-time deployment across various devices using Unity.
3. Integration methods for terrain, weather, and asset data.
4. Implementation of real-time data streaming and client access.
5. Application case studies on floating wind turbines.

The paper acknowledges the immense potential of digital twin applications in the wind energy sector but highlights challenges in data source diversity and real-time data integration. The proposed framework addresses these issues, but further expansion is needed, such as standardization of sensor data and integration of more data sources.