Abstract:Computer vision-based displacement measurement methods have received increasing attention for the structural health monitoring of buildings and infrastructures owing to their advantages over traditional contact sensors. Meanwhile, surveillance cameras widely equipped in urban areas can record a large number of images and videos of buildings and infrastructure, which have the potential to support structural analysis in structural health monitoring or engineering investigations. The three-dimensional (3D) displacement of structures is important for structural analysis. It is challenging for the existing vision-based measurement methods to obtain all the 3D displacement components because they require either multi-view camera systems or additional specially designed targets, which makes it difficult to meet the requirements of measurement applications based on urban surveillance cameras. Therefore, this study proposes a 3D structural displacement measurement method using monocular vision and deep learning based pose estimation. The method uses virtual rendering to synthesize the training set based on the 3D models of the target objects, then trains the deep learning model DPOD (Dense Pose Object Detector) to estimate the poses of the target object, and finally measures the 3D translation of the structures based on the original and destination poses or the original pose and keypoint matching. The effectiveness of the proposed method was validated through static and dynamic experiments. The results showed that the method can meet the needs of obtaining 3D structural displacement and has good accuracy in identifying the principal frequencies of the dynamic responses. The proposed method can support the 3D displacement measurements of buildings and infrastructure based on urban surveillance cameras.

Rapid Position and Pose Measurement Method for Segment Girder Formwork in Precast Girder Yard

Automated Recognition and Measurement Based on Three-Dimensional Point Clouds to Connect Precast Concrete Components

Point Cloud and Machine Learning-Based Automated Recognition and Measurement of Corrugated Pipes and Rebars for Large Precast Concrete Beams

Research Of Noncontact Monitoring System Based On 3d Reconstruction Method In Shipbuilding Processes

Automated Recognition and Measurement Based on 3D Point Cloud for Precast Concrete Components Connection

Automatic Geometric Digital Twin of Box Girder Bridge Using a Laser-Scanned Point Cloud

Measurement, Identification, and Compensation of Pose Errors for Six-Axis Gantry Automated Fiber Placement Machine

Research on 3D Measurement and Rapid Location Technique for Assembling the Special-Shaped Structural Segments

Image-Based Structural Dynamic Displacement Measurement Using Different Multi-Object Tracking Algorithms

Rapid Strain Measurement Technique for Large-Scale Stamping Parts

Automated spacing measurement of formwork system members with 3D point cloud data

Computer Vision-Based Pier Settlement Displacement Measurement of a Multispan Continuous Concrete Highway Bridge under Complex Construction Environments

3D laser scanning for predicting the alignment of large-span segmental precast assembled concrete cable-stayed bridges

Segmentation of Precast Concrete Elements in Outdoor Laser Scan Data Via Image Processing

Multi-Point Displacement Monitoring of Bridges Using A Vision-Based Approach

Rapid and Precise Measurement Method for Track Static Geometry of Large-Span Bridge Railway

Rapid measurement method for cable tension of cable‐stayed bridges using terrestrial laser scanning

Automated flatness assessment for large quantities of full‐scale precast beams using laser scanning

Geometric quality assessment of precast concrete (PC) elements based on 3D structural light scanning

Rapid three-dimension optical deformation measurement for transmission tower with different loads

Three-dimensional Structural Displacement Measurement Using Monocular Vision and Deep Learning Based Pose Estimation