Demystifying Digital Twin Buzzword: A Novel Generic Evaluation Model

Zhengyu Liu,Sina Namaki Araghi,Arkopaul Sarkar,Mohamed Hedi Karray
2023-12-07
Abstract:Despite the growing popularity of digital twin (DT) developments, there is a lack of common understanding and definition for important concepts of DT. It is needed to address this gap by building a shared understanding of DT before it becomes an obstacle for future work. With this challenge in view, the objective of our study is to assess the existing DT from various domains on a common basis and to unify the knowledge and understanding of DT developers and stakeholders before practice. To achieve this goal, we conducted a systematic literature review and analyzed 25 selected papers to identify and discuss the characteristics of existing DT's. The review shows an inconsistency and case-specific choices of dimensions in assessing DT. Therefore, this article proposes a four-dimensional evaluation framework to assess the maturity of digital twins across different domains, focusing on the characteristics of digital models. The four identified dimensions in this model are Capability, Cooperability, Coverage, and Lifecycle. Additionally, a weight mechanism is implemented inside the model to adapt the importance of each dimension for different application requirements. Several case studies are devised to validate the proposed model in general, industrial and scientific cases.
Software Engineering
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that there are significant inconsistencies in the understanding and definition of the Digital Twin (DT) concept in academia and industry, which leads to challenges when evaluating the applicability and maturity of existing Digital Twin frameworks. Specifically, the paper aims to provide a unified Digital Twin evaluation framework through the following research questions to conform to the understanding of Digital Twin by practitioners in different disciplines: - How to provide a unified Digital Twin evaluation framework to conform to the understanding of Digital Twin by practitioners in different disciplines? To answer this question, the paper takes two main steps: 1. **Systematic literature review**: Through a systematic literature review of the development of Digital Twin in the manufacturing field, using the PRISMA method (Preferred Reporting Items for Systematic Reviews and Meta - Analyses), 25 selected papers were analyzed, revealing the inconsistencies in Digital Twin evaluation. 2. **Proposing an evaluation model**: An evaluation model was introduced, which can not only effectively evaluate existing Digital Twins but also provides a framework to align the understanding of stakeholders in the Digital Twin design stage. ### Main contributions - **Systematic literature review**: Revealed the consistencies and inconsistencies in Digital Twin evaluation, especially the differences in evaluation criteria and dimensions. - **Four - dimensional classification model**: Proposed a four - dimensional classification model based on Capability, Cooperability, Comprehensiveness and Lifecycle. - **Maturity assessment**: Proposed two basic conditions and a quantitative maturity assessment method, and verified the effectiveness of the model through multi - disciplinary case studies. ### Evaluation framework The evaluation framework proposed in the paper is divided into three stages: 1. **Basic conditions**: Evaluate whether the Digital Twin meets two basic conditions, namely two - way data exchange capability and real - time synchronization capability. 2. **Classification model**: Conduct a qualitative evaluation of the Digital Twin according to the four - dimensional classification model (Capability, Cooperability, Comprehensiveness and Lifecycle). 3. **Maturity scoring**: Calculate the maturity score of each dimension through a weighting mechanism to meet the needs of different application scenarios. ### Case studies The paper verified the effectiveness of the proposed evaluation framework through multiple interdisciplinary case studies, including general, industrial and scientific cases. ### Conclusions Although Digital Twin is becoming more and more popular in academia and industry, there are significant differences in the understanding of its concept and definition. Through a systematic literature review and the proposal of a general evaluation framework, the paper aims to bridge these differences and promote the design and evaluation of Digital Twin in different fields.