Abstract:Computer vision-based displacement measurement methods have received increasing attention for the structural health monitoring of buildings and infrastructures owing to their advantages over traditional contact sensors. Meanwhile, surveillance cameras widely equipped in urban areas can record a large number of images and videos of buildings and infrastructure, which have the potential to support structural analysis in structural health monitoring or engineering investigations. The three-dimensional (3D) displacement of structures is important for structural analysis. It is challenging for the existing vision-based measurement methods to obtain all the 3D displacement components because they require either multi-view camera systems or additional specially designed targets, which makes it difficult to meet the requirements of measurement applications based on urban surveillance cameras. Therefore, this study proposes a 3D structural displacement measurement method using monocular vision and deep learning based pose estimation. The method uses virtual rendering to synthesize the training set based on the 3D models of the target objects, then trains the deep learning model DPOD (Dense Pose Object Detector) to estimate the poses of the target object, and finally measures the 3D translation of the structures based on the original and destination poses or the original pose and keypoint matching. The effectiveness of the proposed method was validated through static and dynamic experiments. The results showed that the method can meet the needs of obtaining 3D structural displacement and has good accuracy in identifying the principal frequencies of the dynamic responses. The proposed method can support the 3D displacement measurements of buildings and infrastructure based on urban surveillance cameras.

3D displacement measurement model for health monitoring of structures using a motion capture system

Distributed High-Speed Videogrammetry for Real-Time 3D Displacement Monitoring of Large Structure on Shaking Table

Variational Mode Decomposition-Based Multirate Data-Fusion Framework for Estimating Structural Dynamic Displacement by Integrating Vision- and Acceleration-Based Measurements

Image-Based Structural Dynamic Displacement Measurement Using Different Multi-Object Tracking Algorithms

Displacement measurement of large structures using nonoverlapping field of view multi-camera systems under six degrees of freedom ego-motion

Three-dimensional Structural Displacement Measurement Using Monocular Vision and Deep Learning Based Pose Estimation

Self-calibrating technique for 3D displacement measurement using monocular vision and planar marker

Vision-based Structural Displacement Measurement: System Performance Evaluation and Influence Factor Analysis

Structural displacement estimation using accelerometer and FMCW millimeter wave radar

Measurement of Dynamic Characteristics on Structure using Non-marker Vision-based Displacement Measurement System

Improved Image-Based, Full-Field Structural Displacement Measurement using Template Matching and Camera Calibration Methods

A Vision-Based System for Dynamic Displacement Measurement of Long-Span Bridges: Algorithm and Verification

Monocular vision based 3D vibration displacement measurement for civil engineering structures

Multi-Point Displacement Monitoring of Bridges Using A Vision-Based Approach

GNSS Aided Long-Range 3D Displacement Sensing for High-Rise Structures with Two Non-Overlapping Cameras

A Tandem Marker-Based Motion Capture Method for Dynamic Small Displacement Distribution Analysis

High-speed Videogrammetric Measurement of the Displacement of Suspendome Structure Node

Biomechanical model-based displacement estimation in micro-sensor motion capture

Continuous Structural Displacement Monitoring Using Accelerometer, Vision, and Infrared (IR) Cameras

Improving Displacement Measurement Accuracy by Compensating for Camera Motion and Thermal Effect on Camera Sensor

Development and Application of a Vision-Based Displacement Measurement System for Structural Health Monitoring of Civil Structures