Abstract:PurposeThe purpose of this paper is to present a visual detection approach to predict the poses of target objects placed in arbitrary positions before completing the corresponding tasks in mobile robotic manufacturing systems.Design/methodology/approachA hybrid visual detection approach that combines monocular vision and laser ranging is proposed based on an eye-in-hand vision system. The laser displacement sensor is adopted to achieve normal alignment for an arbitrary plane and obtain depth information. The monocular camera measures the two-dimensional image information. In addition, a robot hand-eye relationship calibration method is presented in this paper.FindingsFirst, a hybrid visual detection approach for mobile robotic manufacturing systems is proposed. This detection approach is based on an eye-in-hand vision system consisting of one monocular camera and three laser displacement sensors and it can achieve normal alignment for an arbitrary plane and spatial positioning of the workpiece. Second, based on this vision system, a robot hand-eye relationship calibration method is presented and it was successfully applied to a mobile robotic manufacturing system designed by the authors’ team. As a result, the relationship between the workpiece coordinate system and the end-effector coordinate system could be established accurately.Practical implicationsThis approach can quickly and accurately establish the relationship between the coordinate system of the workpiece and that of the end-effector. The normal alignment accuracy of the hand-eye vision system was less than 0.5° and the spatial positioning accuracy could reach 0.5 mm.Originality/valueThis approach can achieve normal alignment for arbitrary planes and spatial positioning of the workpiece and it can quickly establish the pose relationship between the workpiece and end-effector coordinate systems. Moreover, the proposed approach can significantly improve the work efficiency, flexibility and intelligence of mobile robotic manufacturing systems.

Sensor-Based Control Using an Image Point and Distance Features for Rivet-in-Hole Insertion.

Hybrid Visual Servoing for Rivet-in-hole Insertion Based on Super-twisting Sliding Mode Control

Hybrid Position/Force Control for Dual-Machine Drilling and Riveting System

Robot Base Frame Calibration with a 2D Vision System for Mobile Robotic Drilling

Development of a Monocular Vision System for Robotic Drilling.

Coordination error control for accurate positioning in movable robotic drilling

Partition-Based Planar Image Dynamic Measurement For Position Control Of 2dof Pneumatic Robot

Design of DOB-based Riveting Force Controller for Dual-Machine Horizontal Drilling and Riveting System

A Noncontact Control Strategy for Circular Peg-in-Hole Assembly Guided by the 6-DOF Robot Based on Hybrid Vision

Laser tracker-based control for peg-in-hole assembly robot

Design and Implementation of Multifunctional Automatic Drilling End Effector

Hybrid Calibration and Detection Approach for Mobile Robotic Manufacturing Systems.

Laser tracker based robotic assembly system for large scale peg-hole parts

An Automatic Tracking Approach for Aircraft Skin Drilling and Riveting Robot by Using Monocular Vision Technology

A Multi-Sensor System For Optical Precise Assembly

Image-based visual servoing using a set for multiple pin-in-hole assembly

Servo Control Technology for Automatic Screw-Tightening Process of Robotic Arm Based on Multi-Vision Sensor

Calibration of the laser displacement sensor and integration of on-site scanned points

An Approach for Peg-in-Hole Assembling Based on Force Feedback Control

Automated visual positioning and precision placement of a workpiece using deep learning

Adaptive Image-Based Positioning of RCM Mechanisms Using Angle and Distance Features