Abstract:For robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities to visually identify grasps for a given object. A grasp describes how a robotic end-effector can be arranged to securely grab an object and successfully lift it without slippage. Traditionally, grasp detection requires expert human knowledge to analytically form the task-specific algorithm, but this is an arduous and time-consuming approach. During the last five years, deep learning methods have enabled significant advancements in robotic vision, natural language processing, and automated driving applications. The successful results of these methods have driven robotics researchers to explore the use of deep learning methods in task-generalised robotic applications. This paper reviews the current state-of-the-art in regards to the application of deep learning methods to generalised robotic grasping and discusses how each element of the deep learning approach has improved the overall performance of robotic grasp detection. Several of the most promising approaches are evaluated and the most suitable for real-time grasp detection is identified as the one-shot detection method. The availability of suitable volumes of appropriate training data is identified as a major obstacle for effective utilisation of the deep learning approaches, and the use of transfer learning techniques is proposed as a potential mechanism to address this. Finally, current trends in the field and future potential research directions are discussed.

Review of Deep Reinforcement Learning for Robot Manipulation

Learning Robot Manipulation Skills from Human Demonstration Videos Using Two-Stream 2-D/3-D Residual Networks with Self-Attention

A Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation

Deep Reinforcement Learning for the Control of Robotic Manipulation: A Focussed Mini-Review

A Review on Robot Manipulation Methods in Human-Robot Interactions

A review on reinforcement learning for contact-rich robotic manipulation tasks

Reinforcement Learning for Robotic Grasping and Manipulation: A Review

Deep learning in robotics: a review of recent research

Learning for a Robot: Deep Reinforcement Learning, Imitation Learning, Transfer Learning

Dexterous Manipulation for Multi-Fingered Robotic Hands With Reinforcement Learning: A Review

Review of Learning-Based Robotic Manipulation in Cluttered Environments

Deep Reinforcement Learning for Robotic Manipulation-The state of the art

Reinforcement learning for robot research: A comprehensive review and open issues

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes

How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learned

Review of Deep Learning Methods in Robotic Grasp Detection

A Deep Reinforcement Learning Solution for the Low Level Motion Control of a Robot Manipulator System

How to train your robot with deep reinforcement learning: lessons we have learned