Abstract:The phenomenon of angular inclination of flexible structures during vibration poses a significant challenge to the applicability of visual vibration measurement methods because the target locked in the captured image will produce unknown geometric deformations such as scale, displacement, and angle in the time domain space, and the horizontal rectangular frame used for matching during target detection will also increase the false detection rate of the target due to the introduction of more background information. Such subtle geometric deformations and false detections can lead to severe fit errors in the displacement curves regressed by the visual vibration measurement algorithm. To effectively improve the accuracy and robustness of vibration image target recognition, this article takes the flexible body captured by a high-speed camera as the target of vibration displacement measurement. It introduces the rotating target detection method based on deep learning into the field of visual vibration measurement, which verifies the feasibility of the deep learning method in flexible body vibration measurement, and based on the deep convolutional neural network framework, a high-precision displacement measurement algorithm based on single-stage anchor-free rotating target detection is proposed. The algorithm in this article first uses the CSPDarknet backbone network to extract multi-scale features of flexible structural image sequences. It then uses PANet to fuse the top-down and bottom-up bidirectional feature maps of the four bridge target feature maps obtained through the backbone network. The shallow and deep information is used for semantic feature fusion and combined with the Coordinate Attention mechanism to achieve target finding and fine positioning on the feature map. Finally, we use the coordinates of the bounding box obtained from the test to regress the position offset of the object's center point. To verify the accuracy of the algorithm in this article, we conducted experimental validation on the cable-stayed bridge model and the actual bridge and compared the performance with the traditional template matching algorithm, differential optical flow method, and various deep learning algorithms with different localization principles, as well as the displacement signals collected and processed by accelerometers. The experimental results of time-frequency characteristics analysis show that the vibration displacement trajectories regressed by the algorithm in this paper have the best overlap with the displacement measurements collected by the accelerometer, which verifies that the algorithm in this article has good application potential and implementation space in the field of condition monitoring of flexible structural bodies.

A lightweight convolutional neural network for multipoint displacement measurements on bridge structures

Multi-Point Displacement Monitoring of Bridges Using A Vision-Based Approach

A Vision-Based System for Dynamic Displacement Measurement of Long-Span Bridges: Algorithm and Verification

A Single-stage Anchor-free Rotating Target Visual Detection Algorithm Suitable for Flexible Body Vibration Displacement Measurement

Vibration displacement measurement of bridge structural models using image super-resolution reconstruction and visual object detection network

Image-Based Structural Dynamic Displacement Measurement Using Different Multi-Object Tracking Algorithms

Bridge Vibration Measurements Using Different Camera Placements and Techniques of Computer Vision and Deep Learning

Machine Learning-Based Distraction-Free Method for Measuring the Optical Displacement of Long-Span Bridge Structures

Computer Vision-Based Pier Settlement Displacement Measurement of a Multispan Continuous Concrete Highway Bridge under Complex Construction Environments

An image-based bridge displacement field measurement method with self-vibration elimination

A Multi-channel Input Framework for Structure Displacement Response Prediction Using Convolutional Neural Network

Target-free 3D tiny structural vibration measurement based on deep learning and motion magnification

Real‐time displacement measurement for long‐span bridges using a compact vision‐based system with speed‐optimized template matching

An accurate and distraction-free vision-based structural displacement measurement method integrating Siamese network based tracker and correlation-based template matching

Vision-based multi-point real-time monitoring of dynamic displacement of large-span cable-stayed bridges

Automatic Displacement and Vibration Measurement in Laboratory Experiments with A Deep Learning Method

Computer vision based target-free 3D vibration displacement measurement of structures

Robust optical displacement measurement of bridge structures in complex environments

Displacement response estimation of a cable-stayed bridge subjected to various loading conditions with one-dimensional residual convolutional autoencoder method

Real-time estimation of bridge displacements under vehicle loads using physical mechanism-based attention-LSTM network with partial strain measurements

Complex image background segmentation for cable force estimation of urban bridges with drone‐captured video and deep learning