Abstract:In industrial production, the accuracy of depth measurement during casting gripping is often significantly compromised due to the influence of abnormal vibration, hindering the accurate positioning of the target casting. For this reason, this study proposes an RGB-D camera-based depth measurement method for castings in dynamic environments. The method initially achieves target point detection by embedding the gated differentiable image processing (GDIP) module into the YOLOv8 model and utilizes an enhanced DeepSORT algorithm to track the castings efficiently. Building upon this foundation, the statistically filtered point cloud depth data is fused with the inertial measurement unit (IMU) data processed by complementary filtering via an adaptive untraceable Kalman filter (AUKF) to ensure precise depth measurement results. The method is validated through simulations and field experiments, demonstrating superior robustness and accuracy compared to traditional depth measurement techniques in dynamic industrial environments. The simulation experiments evaluate the performance across varying vibration frequencies (10 Hz, 20 Hz, 40 Hz) and vibration amplitudes (1 mm, 2 mm, 5 mm). The results indicate that the system effectively mitigates interference while maintaining stable depth measurements under high-frequency and large-amplitude vibration conditions, significantly reducing relative error. In a real industrial environment, the depth measurement of a casting located 395 mm from the vibration source was improved from 4.757 to 2.336 mm, and the relative standard deviation (RSD) decreased from 0.24% to 0.12% through AUKF fusion. This study demonstrates that the depth measurement method proposed in this paper substantially enhances the robustness of depth measurement in heavy machinery vibration environments, ensuring stability and accuracy under real production conditions.

A Bolt Positioning Method Using Depth Map and Color Image Fusion from a Depth Camera

Bolt 3D Point Cloud Segmentation and Measurement Based on DBSCAN Clustering

Positioning Aviation Bolts in Narrow Spaces: A Deep Learning-Based Visual Approach at Arbitrary Shooting Angles

Bolt loosening angle detection through arrangement shape-independent perspective transformation and corner point extraction based on semantic segmentation results

Depth map enhancement based on color and depth consistency

Robot Base Frame Calibration with a 2D Vision System for Mobile Robotic Drilling

A Detection Method of Bolts on Axlebox Cover Based on Cascade Deep Convolutional Neural Network

Computer Vision-Based Autonomous Method for Quantitative Detection of Loose Bolts in Bolted Connections of Steel Structures

The Visual Positioning Method of Substation Robot Busbars fittings

Automatic Inspection of Bridge Bolts Using Unmanned Aerial Vision and Adaptive Scale Unification-Based Deep Learning

3D vision-based bolt loosening assessment using photogrammetry, deep neural networks, and 3D point-cloud processing

Quasi-autonomous bolt-loosening detection method using vision-based deep learning and image processing

Image-Based Bolt-Loosening Detection Using a Checkerboard Perspective Correction Method

Detection of Missing Bolts for Engineering Structures in Natural Environment Using Machine Vision and Deep Learning

Bolt loosening assessment using ensemble vision models for automatic localization and feature extraction with target‐free perspective adaptation

Bolt loosening angle measurement along full range of screw exposure length based on 3D point cloud

Image-based bolt self-localization and bolt-loosening detection using deep learning and an improved homography-based prospective rectification method

RGB-D Camera-Based Depth Measurement of Castings in Dynamic Environments

Image-based monitoring of bolt loosening through deep-learning-based integrated detection and tracking

Vision-Based Real-Time Bolt Loosening Detection by Identifying Anti-Loosening Lines

Image‐based monitoring of bolt loosening through deep‐learning‐based integrated detection and tracking