Abstract:In the robot finishing process of the assembly interface of large aerospace cylindrical components (short for assembly interface), to realize the high-precision and high-efficiency pose perception of the large component, an intelligent pose measurement method for the large component is proposed based on binocular vision and priori data. In this method, the global coordinate system of the robot finishing system is initially established using laser tracking measurement method and customized reference plates, giving a unified coordinate transformation datum for the interoperation of the finishing system's subsystems. Then, utilizing deep learning and digital image processing technologies, an algorithm for recognizing and locating key features of the large component is developed, which can realize the identification of key feature types and accurate localization of feature centroids. Following that, the global coordinate of the key feature centroid is determined using the proposed binocular vision three-dimensional (3D) coordinate reconstruction method. Meanwhile, by introducing the priori processing data of the large component to match the 3D reconstruction coordinates of the key feature centroids, the spatial pose of the large component can be calculated with high precision. Finally, the proposed method is experimentally validated using a case study of a large aerospace cylindrical component. Experimental results prove that the proposed method can achieve high-precision pose measurement of the large component, which can provide pose data support for the adjustment or modification of the cutting path of the robot that is generated by the as-designed model of the large component, to ensure the correctness of the robotic machining of the assembly interface, and thus the proposed method can meet the robot finishing needs of the large component.

A computer vision-based approach to automatically extracting the aligning information of precast structural components

Automated Recognition and Measurement Based on Three-Dimensional Point Clouds to Connect Precast Concrete Components

An Alignment Object Detection Method for Automatically Erecting Precast Components

Point Cloud and Machine Learning-Based Automated Recognition and Measurement of Corrugated Pipes and Rebars for Large Precast Concrete Beams

Automated Recognition and Measurement Based on 3D Point Cloud for Precast Concrete Components Connection

Pose Alignment of Aircraft Structures with Distance Sensors and CCD Cameras

Automatic assembly of prefabricated components based on vision-guided robot

Vision-based Excavator Pose Estimation for Automatic Control

On-site visualization of building component erection enabled by integration of four-dimensional modeling and automated surveying

Point Cloud-Based Dimensional Quality Assessment of Precast Concrete Components Using Deep Learning

Image-based Onsite Object Recognition for Automatic Crane Lifting Tasks

3D laser scanning for predicting the alignment of large-span segmental precast assembled concrete cable-stayed bridges

Concrete structure assembly technology based on 3D intelligent image analysis

An Automatic Extraction Method of Rebar Processing Information Based on Digital Image

Automatic concrete defect detection and reconstruction by aligning aerial images onto semantic‐rich building information model

Rebar-tying Robot based on machine vision and coverage path planning

Binocular vision and priori data based intelligent pose measurement method of large aerospace cylindrical components

Visual Sensor-Guided Robotic Adaptive Assembly of Aero Aluminum Alloy Tube

Intelligent assembly assistance for hull structure construction based on optical projection

Automatic Soldering System Based on Computer Vision

Computer Vision-Based Pier Settlement Displacement Measurement of a Multispan Continuous Concrete Highway Bridge under Complex Construction Environments