Abstract:Current research on dynamic displacement measurement based on computer vision mostly requires professional high-speed cameras and an ideal shooting environment to ensure the performance and accuracy of the analysis. However, the high cost of the camera and strict requirements of sharp image contrast and stable environment during the shooting process limit the broad application of the technology. This paper proposes an improved vision method to implement multi-point dynamic displacement measurements with smartphones in an interference environment. A motion-enhanced spatio-temporal context (MSTC) algorithm is developed and applied together with the optical flow (OF) algorithm to realize a simultaneous tracking and dynamic displacement extraction of multiple points on a vibrating structure in the interference environment. Finally, a sine-sweep vibration experiment on a cantilever sphere model is presented to validate the feasibility of the proposed method in a wide-band frequency range. In the test, a smartphone was used to shoot the vibration process of the sine-sweep-excited sphere, and illumination change, fog interference, and camera jitter were artificially simulated to represent the interference environment. The results of the proposed method are compared to conventional displacement sensor data and current vision method results. It is demonstrated that, in an interference environment, (1) the OF method is prone to mismatch the feature points and leads to data deviated or lost; (2) the conventional STC method is sensitive to target selection and can effectively track those targets having a large proportion of pixels in the context with motion tendency similar to the target center; (3) the proposed MSTC method, however, can ease the sensitivity to target selection through in-depth processing of the information in the context and finally enhance the robustness of the target tracking. In addition, the MSTC method takes less than one second to track each target between adjacent frame images, implying a potential for online measurement.

Enhanced Video Motion Magnification Utilizing Envelop Shift for Vision-Based Vibration Measurements

Image Displacement Detection Using Double Phase-Encoded Joint Transform Correlator Based on Wavelet Denoising

Image Stabilization Using Motion Estimation and Micro-mechanical Compensation

Wavefront Modulation with Spatial Light Modulator for Fourier Ptychographic Microscopy

Full-field Extraction of Subtle Displacement Components Via Phase-Projection Wavelet Denoising for Vision-Based Vibration Measurement

Variational Mode Decomposition-Based Multirate Data-Fusion Framework for Estimating Structural Dynamic Displacement by Integrating Vision- and Acceleration-Based Measurements

Optical Correlator Based System For Displacement Auto Detection

Video Acceleration Magnification

Exploiting phase-based motion magnification for the measurement of subtle 3D deformation maps with FP + 2D-DIC

Image Processing for Motion Magnification

Time-Varying Motion Filtering for Vision-Based Nonstationary Vibration Measurement

Motion-induced error reduction for high-speed dynamic digital fringe projection system

An Improved Vision Method for Robust Monitoring of Multi-Point Dynamic Displacements with Smartphones in an Interference Environment

Image-Based Structural Dynamic Displacement Measurement Using Different Multi-Object Tracking Algorithms

An on-line phase measuring profilometry: Processed modulation using for pixel matching

Vibration Measurement with Video Processing Based on Alternating Optimization of Frequency and Phase Shifts

Efficient Vibration Measurement and Modal Shape Visualization Based on Dynamic Deviations of Structural Edge Profiles

Event-Based Motion Magnification

Deformation Monitoring of Tunnel using Phase-based Motion Magnification and Optical Flow

Learning-based Axial Video Motion Magnification

EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering within Transformer