Abstract:Visual vibration measurement has emerged in the field of structural health monitoring in recent years, but it still has some shortcomings in terms of resolution, recognition rate and real-time performance. Considering the three aspects of recovering high-frequency image details, improving the compactness of the target bounding box, and reducing the computational time, we use the constructed image super-resolution reconstruction model and target detection model to measure the vibration displacement of the bridge structural model. First, we integrate the Transformer module into the Unet network with a simple structure. The Swin and Global Transformer Unet (SGTU) module constructed in this form can reduce the computational cost while reconstructing the large-resolution feature map target, and it can sharply edge information of the vibration target. We use the framework of the YOLOv5 algorithm as the backbone, and use the GhostBottleneck (GB) module to reduce the time for convolution operations to generate similar features. In addition, the proposed DWCBottleneck (DWCB) fusion module is also able to achieve high-level semantic fusion and network depth expansion with minimal computational cost. Finally, the center point offset of the bounding box predicted by the model can be used to obtain the displacement offset of the object in the image sequence. The position information of the target in the first frame image is used as the reference frame for calculating the offset, and the vibration displacement of the flexible structure in the image coordinate system is obtained by calculating the deviation of the displacement between the remaining frames and the first frame. We perform qualitative and quantitative comparisons in three aspects: video super-resolution reconstruction, visual detection robustness, and sensor vibration measurement displacement using a homemade vibration image dataset. The time-frequency domain displacement curves regressed by the visual vibration measurement algorithm are compared with the curves acquired after accelerometer acquisition, indicating the necessity of super-resolution reconstruction in visual vibration measurement.

Measurement Algorithm of Building Vibration Displacement Based on Image Signal Processing

Variational Mode Decomposition-Based Multirate Data-Fusion Framework for Estimating Structural Dynamic Displacement by Integrating Vision- and Acceleration-Based Measurements

Optical Correlator Based System For Displacement Auto Detection

Image-Based Structural Dynamic Displacement Measurement Using Different Multi-Object Tracking Algorithms

Full-field Extraction of Subtle Displacement Components Via Phase-Projection Wavelet Denoising for Vision-Based Vibration Measurement

Vision-based Structural Displacement Measurement: System Performance Evaluation and Influence Factor Analysis

Edge‐Enhanced Matching for Gradient‐Based Computer Vision Displacement Measurement

Non-contact measurement of structural dynamic displacement based on improved edge detection and video interpolation

Wireless Binocular Stereovision Measurement System Based on Improved Coarse-to-Fine Matching Algorithm

A Vision-Based System for Dynamic Displacement Measurement of Long-Span Bridges: Algorithm and Verification

Structure displacement extraction method based on image feature matching

Identification of Structural Dynamic Characteristics Based on Machine Vision Technology

Micro-amplitude vibration measurement using vision-based magnification and tracking

EET-Hamming monocular high-speed measurement for long-span bridge structure displacement on a shaking table

Vision and Vibration Data Fusion-Based Structural Dynamic Displacement Measurement with Test Validation

Full-field Measurement of Deformation and Vibration using Digital Image Correlation

Image Motion Extraction of Structures Using Computer Vision Techniques: A Comparative Study

A Vision‐based Surface Displacement/strain Measurement Technique Based on Robust Edge‐enhanced Transform and Algorithms for High Spatial Resolution

Vibration Extraction Based on Fast NCC Algorithm and High-Speed Camera

Vibration displacement measurement of bridge structural models using image super-resolution reconstruction and visual object detection network

Computer vision based target-free 3D vibration displacement measurement of structures