Abstract:PurposeThe purpose of this paper is to present a visual detection approach to predict the poses of target objects placed in arbitrary positions before completing the corresponding tasks in mobile robotic manufacturing systems.Design/methodology/approachA hybrid visual detection approach that combines monocular vision and laser ranging is proposed based on an eye-in-hand vision system. The laser displacement sensor is adopted to achieve normal alignment for an arbitrary plane and obtain depth information. The monocular camera measures the two-dimensional image information. In addition, a robot hand-eye relationship calibration method is presented in this paper.FindingsFirst, a hybrid visual detection approach for mobile robotic manufacturing systems is proposed. This detection approach is based on an eye-in-hand vision system consisting of one monocular camera and three laser displacement sensors and it can achieve normal alignment for an arbitrary plane and spatial positioning of the workpiece. Second, based on this vision system, a robot hand-eye relationship calibration method is presented and it was successfully applied to a mobile robotic manufacturing system designed by the authors’ team. As a result, the relationship between the workpiece coordinate system and the end-effector coordinate system could be established accurately.Practical implicationsThis approach can quickly and accurately establish the relationship between the coordinate system of the workpiece and that of the end-effector. The normal alignment accuracy of the hand-eye vision system was less than 0.5° and the spatial positioning accuracy could reach 0.5 mm.Originality/valueThis approach can achieve normal alignment for arbitrary planes and spatial positioning of the workpiece and it can quickly establish the pose relationship between the workpiece and end-effector coordinate systems. Moreover, the proposed approach can significantly improve the work efficiency, flexibility and intelligence of mobile robotic manufacturing systems.

Development of a Novel Mobile Robotic System for Large-Scale Manufacturing

A Novel Motion Coordination Method for Variable-Sized Multi-Mobile Robots

Robot Base Frame Calibration with a 2D Vision System for Mobile Robotic Drilling

Novel Mode and Equipment for Machining Large Complex Components

Design of a Mixed Robotic Machining System and Its Application in Support Removal from Metal Additive Manufactured Thin-Wall Parts

A Mobile Hybrid Robot and Its Accuracy Issue in Machining of Large-Scale Structures

A Robotic Milling System Based on 3D Point Cloud

Multimobile Robot Cluster System for Robot Machining of Large-Scale Workpieces

A Mobile Additive Manufacturing Robot Framework for Smart Manufacturing Systems

A Mobile Robotic Measurement System for Large-scale Complex Components Based on Optical Scanning and Visual Tracking

Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D Measurement

Mobile Collaborative Welding System for Complex Welding Seams

Hybrid Calibration and Detection Approach for Mobile Robotic Manufacturing Systems.

Open-architecture of CNC system and mirror milling technology for a 5-axis hybrid robot

A novel surface topography prediction method for hybrid robot milling considering the dynamic displacement of end effector

A quantitative investigation for deployment of mobile collaborative robots in high-value manufacturing

A Novel Material Handling System for Transporting Large-Size Components Using Multiple Collaborative Autonomous Mobile Robots

Research on Large-Scale Additive Manufacturing Based on Multi-Robot Collaboration Technology

Research on Mobile Robot Processing System Based on Shape and Position Measurement

Mobile-robotic machining for large complex components: A review study

Development and Verification of a Novel Robot-Integrated Fringe Projection 3D Scanning System for Large-Scale Metrology