Abstract:<p>Conventional displacement sensing techniques (e.g., laser, linear variable differential transformer) have been widely used in structural health monitoring in the past two decades. Though these techniques are capable of measuring displacement time histories with high accuracy, distinct shortcoming remains such as point-to-point contact sensing which limits its applicability in real-world problems. Video cameras have been widely used in the past years due to advantages that include low price, agility, high spatial sensing resolution, and non-contact. Compared with target tracking approaches (e.g., digital image correlation, template matching, etc.), the phase-based method is powerful for detecting small subpixel motions without the use of paints or markers on the structure surface. Nevertheless, the complex computational procedure limits its real-time inference capacity. To address this fundamental issue, we develop a deep learning framework based on convolutional neural networks (CNNs) that enable real-time extraction of full-field subpixel structural displacements from videos. In particular, two new CNN architectures are designed and trained on a dataset generated by the phase-based motion extraction method from a single lab-recorded high-speed video of a dynamic structure. As displacement is only reliable in the regions with sufficient texture contrast, the sparsity of motion field induced by the texture mask is considered via the network architecture design and loss function definition. Results show that, with the supervision of full and sparse motion field, the trained network is capable of identifying the pixels with sufficient texture contrast as well as their subpixel motions. The performance of the trained networks is tested on various videos of other structures to extract the full-field motion (e.g., displacement time histories), which indicates that the trained networks have generalizability to accurately extract full-field subpixel displacements for pixels with sufficient texture contrast.</p>

Real‐time generic target tracking for structural displacement monitoring under environmental uncertainties via deep learning

Variational Mode Decomposition-Based Multirate Data-Fusion Framework for Estimating Structural Dynamic Displacement by Integrating Vision- and Acceleration-Based Measurements

Robust and versatile vision-based dynamic displacement monitoring of natural feature targets in large-scale structures

An accurate and distraction-free vision-based structural displacement measurement method integrating Siamese network based tracker and correlation-based template matching

Three-dimensional Structural Displacement Measurement Using Monocular Vision and Deep Learning Based Pose Estimation

Image-Based Structural Dynamic Displacement Measurement Using Different Multi-Object Tracking Algorithms

Continuous Structural Displacement Monitoring Using Accelerometer, Vision, and Infrared (IR) Cameras

Environmental effect on vision-based structural dynamic displacement monitoring

Extracting full-field subpixel structural displacements from videos via deep learning

Vision-based Structural Displacement Measurement: System Performance Evaluation and Influence Factor Analysis

An Anti-Occlusion Vision-Based Method for Structural Motion Estimation

A Deep Learning Augmented Vision-Based Method for Measuring Dynamic Displacements of Structures in Harsh Environments

Cost-effective, vision-based multi-target tracking approach for structural health monitoring

Monocular Vision-Based Structural Out-of-plane Motion Estimation Using a Deep Learning Method

Data-Driven Method for Real-Time Reconstruction of the Structural Displacement Field

Vision‐based Displacement Measurement Enhanced by Super‐resolution Using Generative Adversarial Networks

Multi-Point Displacement Monitoring of Bridges Using A Vision-Based Approach

A Multi-channel Input Framework for Structure Displacement Response Prediction Using Convolutional Neural Network

Identification of Structural Dynamic Characteristics Based on Machine Vision Technology

Development and Application of a Vision-Based Displacement Measurement System for Structural Health Monitoring of Civil Structures

Displacement Measurement and 3D Reconstruction of Segmental Retaining Wall Using Deep Convolutional Neural Networks and Binocular Stereovision