Abstract:Purpose Scattered parts are laid randomly during the manufacturing process and have difficulty to recognize and manipulate. This study aims to complete the grasp of the scattered parts by a manipulator with a camera and learning method. Design/methodology/approach In this paper, a cascaded convolutional neural network (CNN) method for robotic grasping based on monocular vision and small data set of scattered parts is proposed. This method can be divided into three steps: object detection, monocular depth estimation and keypoint estimation. In the first stage, an object detection network is improved to effectively locate the candidate parts. Then, it contains a neural network structure and corresponding training method to learn and reason high-resolution input images to obtain depth estimation. The keypoint estimation in the third step is expressed as a cumulative form of multi-scale prediction from a network to use an red green blue depth (RGBD) map that is acquired from the object detection and depth map estimation. Finally, a grasping strategy is studied to achieve successful and continuous grasping. In the experiments, different workpieces are used to validate the proposed method. The best grasping success rate is more than 80%. Findings By using the CNN-based method to extract the key points of the scattered parts and calculating the possibility of grasp, the successful rate is increased. Practical implications This method and robotic systems can be used in picking and placing of most industrial automatic manufacturing or assembly processes. Originality/value Unlike standard parts, scattered parts are randomly laid and have difficulty recognizing and grasping for the robot. This study uses a cascaded CNN network to extract the keypoints of the scattered parts, which are also labeled with the possibility of successful grasping. Experiments are conducted to demonstrate the grasping of those scattered parts.

A Cascaded CNN-based Method for Monocular Vision Robotic Grasping

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network

Enhancement ofreal-timegrasp detection by cascaded deep convolutional neural networks

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

A Grasping CNN with Image Segmentation for Mobile Manipulating Robot

A New Approach Based on Two-stream CNNs for Novel Objects Grasping in Clutter

Robotic Grasping of Novel Objects from RGB-D Images by Using Multi-Level Convolutional Neural Networks

Vision-based robotic grasping using faster R-CNN–GRCNN dual-layer detection mechanism

A Novel Deep Learning-Based Pose Estimation Method for Robotic Grasping of Axisymmetric Bodies in Industrial Stacked Scenarios

A Robotic Grasping Algorithm Based on Simplified Image and Deep Convolutional Neural Network

An Industrial Intelligent Grasping System Based on Convolutional Neural Network

A Vision-based Robot Grasping System

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

DSC-GraspNet: A Lightweight Convolutional Neural Network for Robotic Grasp Detection

A grasping posture estimation method based on 3D detection network

Deep learning-based method for vision-guided robotic grasping of unknown objects

A Multi-task Convolutional Neural Network for Autonomous Robotic Grasping in Object Stacking Scenes

Edge-Dependent Efficient Grasp Rectangle Search in Robotic Grasp Detection

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

Vision-based Robotic Grasp Success Determination with Convolutional Neural Network