Abstract:We propose an active learning-based grasp method for accurate industrial manipulation that combines the high accuracy of geometrically driven grasp methods and the generalization ability of data-driven grasp methods. Our grasp sequence consists of pregrasp stage and grasp stage which integrates the active perception and manipulation. In pregrasp stage, the manipulator actively moves and perceives the object. At each step, given the perception image, a motion is chosen so that the manipulator can adjust to a proper pose to grasp the object. We train a convolutional neural network to estimate the motion and combine the network with a closed-loop control so that the end effector can move to the pregrasp state. In grasp stage, the manipulator executes a fixed motion to complete the grasp task. The fixed motion can be acquired from the demonstration with nonexpert conveniently. Our proposed method does not require the prior knowledge of camera intrinsic parameters, hand-eye transformation, or manually designed feature of objects. Instead, the training data sets containing prior knowledge are collected through interactive perception. The method can be easily transferred to new tasks with a few human interventions and is able to complete high accuracy grasp task with a certain robustness to partial observation condition. In our circuit board grasping tests, we could achieve a grasp accuracy of 0.8 mm and 0.6°. Note to Practitioners—The research in this paper is motivated by the following practical problem. Manipulators on industrial lines can complete high accuracy tasks with hand-crafting features of objects. The perception is only used for object detection and localization. It is not flexible since the prior knowledge differs from tasks, which takes a long time to deploy in a new task. Besides, only well-trained experts are qualified to complete the deployment process. Our grasp method uses a convolutional network to estimate the motion for manipulator directly from images. The camera is mounted on the manipulator and can perceive the object actively. The training data set of the network is specific for different objects that can be automatically collected with a few human interventions. Our method simplifies the deployment process and can be applied in 3C industry (computers, communications, and consumer electronics) where the products upgrade frequently.

Network Convergence Indicator for Efficient Robot Grasping Pose Detection under Limited Computation Resource

Active Learning-Based Grasp for Accurate Industrial Manipulation.

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

Robotic Grasping Technology Integrating Large Kernel Convolution and Residual Connections

A Real-Time Grasping Detection Network Architecture for Various Grasping Scenarios

Lightweight robotic grasping detection network based on dual attention and inverted residual

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Vision-Based Intelligent Robot Grasping Using Sparse Neural Network

A new differentiable architecture search method for optimizing convolutional neural networks in the digital twin of intelligent robotic grasping

A pixel-level grasp detection method based on Efficient Grasp Aware Network

High Precision 6-DoF Grasp Detection in Cluttered Scenes Based on Network Optimization and Pose Propagation

Light-Weight Convolutional Neural Networks for Generative Robotic Grasping

GR-ConvNet v2: A Real-Time Multi-Grasp Detection Network for Robotic Grasping

VMGNet: A Low Computational Complexity Robotic Grasping Network Based on VMamba with Multi-Scale Feature Fusion

Efficient End-to-End 6-Dof Grasp Detection Framework for Edge Devices with Hierarchical Heatmaps and Feature Propagation

FastGNet: An Efficient 6-DOF Grasp Detection Method with Multi-Attention Mechanisms and Point Transformer Network

REGNet V2: End-to-End REgion-based Grasp Detection Network for Grippers of Different Sizes in Point Clouds

ICGNet: A Unified Approach for Instance-Centric Grasping

FCN-Pose: A Pruned and Quantized CNN for Robot Pose Estimation for Constrained Devices

Fast GraspNeXt: A Fast Self-Attention Neural Network Architecture for Multi-task Learning in Computer Vision Tasks for Robotic Grasping on the Edge