Abstract:Digital Twins technology is revolutionizing decision-making in scientific research by integrating models and simulations with real-time data. Unlike traditional Structural Health Monitoring methods, which rely on computationally intensive Digital Image Correlation and have limitations in real-time data integration, this research proposes a novel approach using Artificial Intelligence. Specifically, Convolutional Neural Networks are employed to analyze structural behaviors in real-time by correlating Digital Image Correlation speckle pattern images with deformation fields. Initially focusing on two-dimensional speckle patterns, the research extends to three-dimensional applications using stereo-paired images for comprehensive deformation analysis. This method overcomes computational challenges by utilizing a mix of synthetically generated and authentic speckle pattern images for training the Convolutional Neural Networks. The models are designed to be robust and versatile, offering a promising alternative to traditional measurement techniques and paving the way for advanced applications in three-dimensional modeling. This advancement signifies a shift towards more efficient and dynamic structural health monitoring by leveraging the power of Artificial Intelligence for real-time simulation and analysis.

What problem does this paper attempt to address?

The main problems that this paper attempts to solve are the limitations of traditional structural health monitoring (SHM) methods in real - time data analysis and processing, especially the computational complexity of digital image correlation (DIC) technology and the difficult problem of parameter selection. Specifically: 1. **Real - time data integration and analysis**: - Traditional DIC methods are computationally intensive and difficult to achieve real - time data integration and analysis. - Existing SHM methods usually rely on computationally intensive DIC, which limits their real - time performance in practical applications. 2. **Complexity of parameter selection**: - The DIC method needs to select multiple parameters (such as subset size, interpolation method, image filtering and correlation function). The selection of these parameters has a significant impact on the measurement accuracy, and there is a lack of standardized adjustment guidelines. 3. **Improving measurement efficiency and accuracy**: - Existing methods are time - consuming when dealing with large - scale structural deformation measurements and require several hours of manual work. - A more efficient method is needed to quickly extract and analyze the full - field deformation of large - area structures. To solve these problems, this research proposes a visual measurement extraction method based on deep learning, which uses convolutional neural networks (CNNs) to extract deformation fields from limited data. The main innovations of this method include: - **Real - time processing**: By directly extracting the deformation field from the image sequence through the deep - learning model, rapid and automated real - time monitoring is achieved. - **No need for complex parameter selection**: It avoids the complex parameter selection process in traditional DIC methods and simplifies the operation process. - **High - precision prediction**: Through an end - to - end learning framework, the strain field is directly predicted, which improves the measurement accuracy and efficiency. - **Application of transfer learning**: By using transfer learning technology, training is carried out on a limited data set, which improves the generalization ability of the model. In conclusion, this research aims to overcome the shortcomings of traditional DIC methods in real - time and computational efficiency by introducing deep - learning technology, and to provide a more efficient and accurate solution for structural health monitoring.

Deep learning-based Visual Measurement Extraction within an Adaptive Digital Twin Framework from Limited Data Using Transfer Learning

A Framework for Digital Twin of Civil Infrastructure— Challenges & Opportunities

Scientific Machine Learning Enables Multiphysics Digital Twins of Large-Scale Electronic Chips

Deep-learning-enhanced digital twinning of complex composite structures and real-time mechanical interaction

Cloud-Based Digital Twinning for Structural Health Monitoring Using Deep Learning

Image-based Deep Learning for Smart Digital Twins: a Review

Algorithm-driven Advances for Scientific CT Instruments: From Model-based to Deep Learning-based Approaches

A physics-embedded deep-learning framework for efficient multi-fidelity modeling applied to guided wave based structural health monitoring

Deep learning-based structural health monitoring through the infusion of optical photos and vibration data

Digital Twins Model of Industrial Product Management and Control Based on Lightweight Deep Learning

Digital Twin Data Modelling by Randomized Orthogonal Decomposition and Deep Learning

Design of Digital Twin Sensing Strategies Via Predictive Modeling and Interpretable Machine Learning

Bidirectional graphics-based digital twin framework for quantifying seismic damage of structures using deep learning networks

From Physics-Based Models to Predictive Digital Twins via Interpretable Machine Learning

Med-Real2Sim: Non-Invasive Medical Digital Twins using Physics-Informed Self-Supervised Learning

A Deep Learning Augmented Vision-Based Method for Measuring Dynamic Displacements of Structures in Harsh Environments

Digital twins that learn and correct themselves

Transfer Learning-enabled Modelling Framework for Digital Twin

Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins

Deep learning-based structural health monitoring