Abstract:Structural displacement is an important indicator of structural safety in structural health monitoring (SHM). As one of the vision-based methods, optical flow can provide displacement measurement of pixels in images. However, estimating structural displacement by predicting the optical flow between the current frame and the initial frame may be subject to limited accuracy due to environmental variations. Alternatively, calculating structural velocity by predicting the optical flow of adjacent frames and integrating to obtain displacement may introduce displacement drift attributable to cumulative errors. This study proposes a hybrid structural displacement estimation method to eliminate the effects of environmental variations and cumulative errors. In comparison to the existing methods, the novelty of the proposed method is to effectively integrate deep learning-based dense optical flow and correlation template matching (CM), for achieving both high accuracy and improved robustness. Deep learning-based dense optical flow was used for optical flow prediction between adjacent frames through correlation calculations and iterative updating to obtain the structural velocity. Pyramid-accelerated CM was employed to locate the regions of interest (ROI) of the structure in each frame, and the structural displacement was then estimated by counting temporal changes in these locations. By fusing estimated structural velocity and displacement using the Kalman filter, optimized structural displacement results were obtained, and temporal cumulative errors using dense optical flow could be eliminated. The proposed method was validated in an indoor shaking table test of a three-story reinforced concrete structure, and an outdoor shaking table test of a cold-formed steel wall system. The results indicated that the proposed method reduced the root mean square error of estimated displacement by over 89% compared with dense optical flow and by over 36% compared with CM. Furthermore, the proposed method was able to process 1080p high-definition images at a rate of 5.43 frames per second, indicating its high efficiency for applications.

Monocular Vision-Based Structural Out-of-plane Motion Estimation Using a Deep Learning Method

Model-informed Deep Learning Strategy with Vision Measurement for Damage Identification of Truss Structures

Stereo Camera Motion Estimation Based on Euclidean Reconstruction

Variational Mode Decomposition-Based Multirate Data-Fusion Framework for Estimating Structural Dynamic Displacement by Integrating Vision- and Acceleration-Based Measurements

Three-dimensional Structural Displacement Measurement Using Monocular Vision and Deep Learning Based Pose Estimation

Structural Displacement Estimation by a Hybrid Computer Vision Approach

An Anti-Occlusion Vision-Based Method for Structural Motion Estimation

Vision-based automatic structural motion estimation in presence of 3D camera motion effects

Multi-view Target-Free Video Structural Motion Estimation: A Self-adaptive Co-calibration Model

Estimating Small Structural Motions from Multi-View Video Measurement

Monocular vision based 3D vibration displacement measurement for civil engineering structures

Identification of Structural Dynamic Characteristics Based on Machine Vision Technology

Image-Based Structural Dynamic Displacement Measurement Using Different Multi-Object Tracking Algorithms

Monitoring of structural dynamic behaviors by vision-based system *

Cost-effective, vision-based multi-target tracking approach for structural health monitoring

Vision-based Structural Displacement Measurement: System Performance Evaluation and Influence Factor Analysis

Real‐time generic target tracking for structural displacement monitoring under environmental uncertainties via deep learning

A target-free video structural motion estimation method based on multi-path optimization

Displacement measurement and nonlinear structural system identification: A vision‐based approach with camera motion correction using planar structures

3D vision‐based out‐of‐plane displacement quantification for steel plate structures using structure‐from‐motion, deep learning, and point‐cloud processing

Estimating Structural Motions in Extreme Environmental Conditions——a Dynamic Correlation Filter Based Computer Vision Approach