Abstract:Purpose Scattered parts are laid randomly during the manufacturing process and have difficulty to recognize and manipulate. This study aims to complete the grasp of the scattered parts by a manipulator with a camera and learning method. Design/methodology/approach In this paper, a cascaded convolutional neural network (CNN) method for robotic grasping based on monocular vision and small data set of scattered parts is proposed. This method can be divided into three steps: object detection, monocular depth estimation and keypoint estimation. In the first stage, an object detection network is improved to effectively locate the candidate parts. Then, it contains a neural network structure and corresponding training method to learn and reason high-resolution input images to obtain depth estimation. The keypoint estimation in the third step is expressed as a cumulative form of multi-scale prediction from a network to use an red green blue depth (RGBD) map that is acquired from the object detection and depth map estimation. Finally, a grasping strategy is studied to achieve successful and continuous grasping. In the experiments, different workpieces are used to validate the proposed method. The best grasping success rate is more than 80%. Findings By using the CNN-based method to extract the key points of the scattered parts and calculating the possibility of grasp, the successful rate is increased. Practical implications This method and robotic systems can be used in picking and placing of most industrial automatic manufacturing or assembly processes. Originality/value Unlike standard parts, scattered parts are randomly laid and have difficulty recognizing and grasping for the robot. This study uses a cascaded CNN network to extract the keypoints of the scattered parts, which are also labeled with the possibility of successful grasping. Experiments are conducted to demonstrate the grasping of those scattered parts.

Enhancement ofreal-timegrasp detection by cascaded deep convolutional neural networks

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

Real-Time Robotic Multigrasp Detection Using Anchor-Free Fully Convolutional Grasp Detector

Real-Time, Highly Accurate Robotic Grasp Detection using Fully Convolutional Neural Networks with High-Resolution Images

FCNN-GraspNet: a Steamlined Neural Network for Robotic Grasp Detection

A Real-Time Grasping Detection Network Architecture for Various Grasping Scenarios

Deep Vision Networks for Real-Time Robotic Grasp Detection

Edge-Dependent Efficient Grasp Rectangle Search in Robotic Grasp Detection

DSC-GraspNet: A Lightweight Convolutional Neural Network for Robotic Grasp Detection

Accurate Robotic Grasp Detection with Angular Label Smoothing

A refined robotic grasp detection network based on coarse-to-fine feature and residual attention

A Cascaded CNN-based Method for Monocular Vision Robotic Grasping

Robotic Grasp Detection Network Based on Improved Deformable Convolution and Spatial Feature Center Mechanism

Vision-based robotic grasping using faster R-CNN–GRCNN dual-layer detection mechanism

A Real-Time Robotic Grasping Approach with Oriented Anchor Box

A robot grasping detection network based on flexible selection of multi-modal feature fusion structure

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Multitarget Flexible Grasping Detection Method for Robots in Unstructured Environments