Abstract:PurposeThe purpose of this paper is to present a visual detection approach to predict the poses of target objects placed in arbitrary positions before completing the corresponding tasks in mobile robotic manufacturing systems.Design/methodology/approachA hybrid visual detection approach that combines monocular vision and laser ranging is proposed based on an eye-in-hand vision system. The laser displacement sensor is adopted to achieve normal alignment for an arbitrary plane and obtain depth information. The monocular camera measures the two-dimensional image information. In addition, a robot hand-eye relationship calibration method is presented in this paper.FindingsFirst, a hybrid visual detection approach for mobile robotic manufacturing systems is proposed. This detection approach is based on an eye-in-hand vision system consisting of one monocular camera and three laser displacement sensors and it can achieve normal alignment for an arbitrary plane and spatial positioning of the workpiece. Second, based on this vision system, a robot hand-eye relationship calibration method is presented and it was successfully applied to a mobile robotic manufacturing system designed by the authors’ team. As a result, the relationship between the workpiece coordinate system and the end-effector coordinate system could be established accurately.Practical implicationsThis approach can quickly and accurately establish the relationship between the coordinate system of the workpiece and that of the end-effector. The normal alignment accuracy of the hand-eye vision system was less than 0.5° and the spatial positioning accuracy could reach 0.5 mm.Originality/valueThis approach can achieve normal alignment for arbitrary planes and spatial positioning of the workpiece and it can quickly establish the pose relationship between the workpiece and end-effector coordinate systems. Moreover, the proposed approach can significantly improve the work efficiency, flexibility and intelligence of mobile robotic manufacturing systems.

Industrial Robot Assembly Line Design Using Machine Vision

Intelligent Operation of Robot for Handling and Assembly Based on Vision Guidance

An Assembly System Based on Industrial Robot with Binocular Stereo Vision

Hybrid Calibration and Detection Approach for Mobile Robotic Manufacturing Systems.

A Robotic Automatic Assembly System Based on Vision

An Industrial Robot Assembly Platform With Dual-Stereo Vision System

Design of assembly line material sorting system based on machine vision

High-Precision Monocular Vision Guided Robotic Assembly Based on Local Pose Invariance

A Positioning System Based on Monocular Vision for Industrial Robots

Research on the Industrial Robot Grasping Method Based on Multisensor Data Fusion and Binocular Vision

Workpieces Sorting System Based on Industrial Robot of Machine Vision

Research And Application Of Vision Intelligent Assembly Robot Based On Halcon Software

Research on the application of machine vision in the design of machine automation

Study and Application of Monocular Vision-Based Assembly Robot

Design of Mobile Phone Automatic Assembly System Based on Machine Vision

Automatic precision robot assembly system with microscopic vision and force sensor

CAD-based 3D Robot Vision.

Research on Key Technologies of target location based on Intelligent Robot

Automatic Assembly of In-Cabin Components Based on Hybrid Guidance of Binocular Vision and Laser Tracker

Design of intelligent 3D collaborative manufacturing platform for non-holonomic mobile industrial robots based on improved binocular vision

Design of Automatic Inspection System Based on PLC and Machine Vision