Abstract:The existing industrial and household robots suffer from insufficient adaptability under increasingly complex scenes and challenges in operating objects. This prevents the manufacturing industry from flexibly responding to environmental changes and has become a pressing issue in current research. To address the aforementioned challenges, we propose a novel RGB-D cross-background robot grasp detection dataset (CBRGD). The dataset aims to enhance the performance of intelligent robots when confronted with diverse and dynamic scenarios. The CBRGD dataset consists of seven different common backgrounds and 58 common objects, covering various grasping scenarios. Alongside the dataset, we also propose a background-adaptive robot multiobject grasp detection network named BA-Grasp. Using the bimodal foreground activation strategy (BFAS), we can suppress background noise while highlighting the target object in the foreground. The multiscale foreground region features enhancement module (MFRFEM), on the other hand, allows the network to adapt to objects of different sizes while highlighting important areas in the foreground. Extensive experiments indicate that our robotic grasping method demonstrates significant advantages when facing various scenarios and complex, variable objects. The proposed method achieved the accuracies of 97.8% and 96.7% on the publicly available Cornell dataset and 94.6% on the Jacquard dataset, which are comparable to the SOTA method. Moreover, on the CBRGD dataset, the proposed method demonstrated an average accuracy improvement of 5%–10% over the SOTA method. Robot grasping experiments validate that our method can maintain high grasping accuracy in real-world applications. Experimental videos and the CBRGD dataset can be found at the following address: https://github.com/meiguiz/BA-Grasp.

Fed-HANet: Federated Visual Grasping Learning for Human Robot Handovers

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

A Human-Robot Collaboration System for Object Handover

Learning Human-to-Robot Dexterous Handovers for Anthropomorphic Hand

Object-Independent Human-to-Robot Handovers Using Real Time Robotic Vision

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

LAC-Net: Linear-Fusion Attention-Guided Convolutional Network for Accurate Robotic Grasping Under the Occlusion

FunGrasp: Functional Grasping for Diverse Dexterous Hands

Autonomous Robotic Manipulation: Real-Time, Deep-Learning Approach for Grasping of Unknown Objects

A Novel RGB-D Cross-Background Robot Grasp Detection Dataset and Background-Adaptive Grasping Network

GenH2R: Learning Generalizable Human-to-Robot Handover via Scalable Simulation, Demonstration, and Imitation

Leveraging Semantic and Geometric Information for Zero-Shot Robot-to-Human Handover

Learning Gentle Grasping from Human-Free Force Control Demonstration

Object Detection and Pose Estimation from RGB and Depth Data for Real-time, Adaptive Robotic Grasping

Recognition of Grasping Patterns Using Deep Learning for Human-Robot Collaboration

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation

Self-supervised 6-DoF Robot Grasping by Demonstration via Augmented Reality Teleoperation System

Efficient Hand Gesture Recognition for Human-Robot Interaction

A Vision-based Robot Grasping System

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations