Abstract:PurposeThe purpose of this paper is to present a visual detection approach to predict the poses of target objects placed in arbitrary positions before completing the corresponding tasks in mobile robotic manufacturing systems.Design/methodology/approachA hybrid visual detection approach that combines monocular vision and laser ranging is proposed based on an eye-in-hand vision system. The laser displacement sensor is adopted to achieve normal alignment for an arbitrary plane and obtain depth information. The monocular camera measures the two-dimensional image information. In addition, a robot hand-eye relationship calibration method is presented in this paper.FindingsFirst, a hybrid visual detection approach for mobile robotic manufacturing systems is proposed. This detection approach is based on an eye-in-hand vision system consisting of one monocular camera and three laser displacement sensors and it can achieve normal alignment for an arbitrary plane and spatial positioning of the workpiece. Second, based on this vision system, a robot hand-eye relationship calibration method is presented and it was successfully applied to a mobile robotic manufacturing system designed by the authors’ team. As a result, the relationship between the workpiece coordinate system and the end-effector coordinate system could be established accurately.Practical implicationsThis approach can quickly and accurately establish the relationship between the coordinate system of the workpiece and that of the end-effector. The normal alignment accuracy of the hand-eye vision system was less than 0.5° and the spatial positioning accuracy could reach 0.5 mm.Originality/valueThis approach can achieve normal alignment for arbitrary planes and spatial positioning of the workpiece and it can quickly establish the pose relationship between the workpiece and end-effector coordinate systems. Moreover, the proposed approach can significantly improve the work efficiency, flexibility and intelligence of mobile robotic manufacturing systems.

Monocular Feed-forward Based 3D Target Aiming Using a 6-DOF Robotic Arm

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

An Object Localization System Using Monocular Camera and Two-Axis-Controlled Laser Ranging Sensor for Mobile Robot

Autonomous Robotic Capture of Non-Cooperative Target by Adaptive Extended Kalman Filter Based Visual Servo

Hybrid Calibration and Detection Approach for Mobile Robotic Manufacturing Systems.

Vision-based Pose and Motion Estimation of Non-cooperative Target for Space Robotic Manipulators

Improve the Estimation of Monocular Vision 6-DOF Pose Based on the Fusion of Camera and Laser Rangefinder

Incremental Visual Servo Control of Robotic Manipulator for Autonomous Capture of Non-Cooperative Target

Position-based visual servo control of autonomous robotic manipulators

Accurate Relative Measurement of Multitarget Poses by Monocular Vision for Nonmodel-Based Real-Time Calibration of Industrial Robot

Research on 6DOF Gripping Position Measurement Strategy of Robot Based on Monocular Vision

Target Recognition and Location Based on Deep Learning

Tracking 3-D Motion of Dynamic Objects Using Monocular Visual-Inertial Sensing

Target Localization and Grasping of NAO Robot Based on YOLOv8 Network and Monocular Ranging

Towards Accurate Task Accomplishment with Low-Cost Robotic Arms

High Precision Pose Estimation for Uncooperative Targets Based on Monocular Vision and 1D Laser Fusion

Real-time 3D Human Tracking for Mobile Robots with Multisensors

Automatic grasping of 3-DOF robotic arm based on visual feedback

Three-dimensional Reconstruction Method Based on Target Recognition for Binocular Humanoid Robot

A Method of Target Tracking Based on Monocular Vision for Mobile Robot in Unknown Environment

Robotic Dynamic Target Recognition and Tracking Based on the Monocular Vision