Abstract:Current research on dynamic displacement measurement based on computer vision mostly requires professional high-speed cameras and an ideal shooting environment to ensure the performance and accuracy of the analysis. However, the high cost of the camera and strict requirements of sharp image contrast and stable environment during the shooting process limit the broad application of the technology. This paper proposes an improved vision method to implement multi-point dynamic displacement measurements with smartphones in an interference environment. A motion-enhanced spatio-temporal context (MSTC) algorithm is developed and applied together with the optical flow (OF) algorithm to realize a simultaneous tracking and dynamic displacement extraction of multiple points on a vibrating structure in the interference environment. Finally, a sine-sweep vibration experiment on a cantilever sphere model is presented to validate the feasibility of the proposed method in a wide-band frequency range. In the test, a smartphone was used to shoot the vibration process of the sine-sweep-excited sphere, and illumination change, fog interference, and camera jitter were artificially simulated to represent the interference environment. The results of the proposed method are compared to conventional displacement sensor data and current vision method results. It is demonstrated that, in an interference environment, (1) the OF method is prone to mismatch the feature points and leads to data deviated or lost; (2) the conventional STC method is sensitive to target selection and can effectively track those targets having a large proportion of pixels in the context with motion tendency similar to the target center; (3) the proposed MSTC method, however, can ease the sensitivity to target selection through in-depth processing of the information in the context and finally enhance the robustness of the target tracking. In addition, the MSTC method takes less than one second to track each target between adjacent frame images, implying a potential for online measurement.

<i>AMT</i>: Acoustic Multi-target Tracking with Smartphone MIMO System

FM-track: Pushing the Limits of Contactless Multi-Target Tracking Using Acoustic Signals

PAMT: Phase-based Acoustic Motion Tracking in Multipath Fading Environments

Contact-Free Multi-Target Tracking Using Distributed Massive MIMO-OFDM Communication System: Prototype and Analysis

ReflecTrack: Enabling 3D Acoustic Position Tracking Using Commodity Dual-Microphone Smartphones

Multi-Target Tracking with Multiple Unmanned Aerial Vehicles Based on Information Fusion

Audio-Visual Bimodal Combination-Based Speaker Tracking Method for Mobile Robot

Neartracker: Acoustic 2-D Target Tracking with Nearby Reflector in Siso System

Mmtai: Biometrics-assisted Multi-person Tracking with Mmwave Radar

Distributed multi-camera multi-target association for real-time tracking

An Improved Vision Method for Robust Monitoring of Multi-Point Dynamic Displacements with Smartphones in an Interference Environment

CTrack: Acoustic Device-Free and Collaborative Hands Motion Tracking on Smartphones

FusionTrack: Towards Accurate Device-free Acoustic Motion Tracking with Signal Fusion

Multi-target tracking based on appearance features and similarity fusion

MilliSonic: Pushing the Limits of Acoustic Motion Tracking

EchoTrack: Acoustic Device-Free Hand Tracking on Smart Phones

PmTrack: Enabling Personalized mmWave-based Human Tracking

Enabling 6D Pose Tracking on Your Acoustic Devices

A robust automatic multi-target tracking algorithm in complex environments

Intelligent Metasurface System for Automatic Near- and Far-Field Tracking of Multi-Target Based on Computer Vision

Moving Target Detection and Tracking for Smartphone Automatic Focusing