Abstract:Structural displacement is an important indicator of structural safety in structural health monitoring (SHM). As one of the vision-based methods, optical flow can provide displacement measurement of pixels in images. However, estimating structural displacement by predicting the optical flow between the current frame and the initial frame may be subject to limited accuracy due to environmental variations. Alternatively, calculating structural velocity by predicting the optical flow of adjacent frames and integrating to obtain displacement may introduce displacement drift attributable to cumulative errors. This study proposes a hybrid structural displacement estimation method to eliminate the effects of environmental variations and cumulative errors. In comparison to the existing methods, the novelty of the proposed method is to effectively integrate deep learning-based dense optical flow and correlation template matching (CM), for achieving both high accuracy and improved robustness. Deep learning-based dense optical flow was used for optical flow prediction between adjacent frames through correlation calculations and iterative updating to obtain the structural velocity. Pyramid-accelerated CM was employed to locate the regions of interest (ROI) of the structure in each frame, and the structural displacement was then estimated by counting temporal changes in these locations. By fusing estimated structural velocity and displacement using the Kalman filter, optimized structural displacement results were obtained, and temporal cumulative errors using dense optical flow could be eliminated. The proposed method was validated in an indoor shaking table test of a three-story reinforced concrete structure, and an outdoor shaking table test of a cold-formed steel wall system. The results indicated that the proposed method reduced the root mean square error of estimated displacement by over 89% compared with dense optical flow and by over 36% compared with CM. Furthermore, the proposed method was able to process 1080p high-definition images at a rate of 5.43 frames per second, indicating its high efficiency for applications.

A Multi-channel Input Framework for Structure Displacement Response Prediction Using Convolutional Neural Network

Structural Surrogate Model and Dynamic Response Prediction with Consideration of Temporal and Spatial Evolution: an Encoder–Decoder ConvLSTM Network

DF-CDM: Conditional Diffusion Model with Data Fusion for Structural Dynamic Response Reconstruction

Dynamic displacement estimation of structures using one-dimensional convolutional neural network

MLA-TCN: Multioutput Prediction of Dam Displacement Based on Temporal Convolutional Network with Attention Mechanism

Novel Physics-Informed Neural Network Approach for Dynamic and Static Displacement Reconstruction Via Strain and Acceleration

Structural Displacement Estimation by a Hybrid Computer Vision Approach

Data-Driven Method for Real-Time Reconstruction of the Structural Displacement Field

A separate modeling approach to noisy displacement prediction of concrete dams via improved deep learning with frequency division

Extracting full-field subpixel structural displacements from videos via deep learning

Prediction of wall deflection induced by braced excavation in spatially variable soils via convolutional neural network

Displacement field calculation of large-scale structures using computer vision with physical constraints

Spatiotemporal deep learning approach on estimation of diaphragm wall deformation induced by excavation

Displacement response estimation of a cable-stayed bridge subjected to various loading conditions with one-dimensional residual convolutional autoencoder method

A lightweight convolutional neural network for multipoint displacement measurements on bridge structures

Landslide displacement prediction with step-like curve based on convolutional neural network coupled with bi-directional gated recurrent unit optimized by attention mechanism

Seismic response prediction method for building structures using convolutional neural network

Landslide Displacement Prediction Based on CEEMDAN Method and CNN–BiLSTM Model

A feature decomposition-based deep transfer learning framework for concrete dam deformation prediction with observational insufficiency

A spatiotemporal deep learning method for excavation-induced wall deflections

Rapid seismic response prediction of RC frames based on deep learning and limited building information