An object planar grasping pose detection algorithm in low-light scenes
Fangzhou Xu,Zhaoxin Zhu,Chao Feng,Jiancai Leng,Peng Zhang,Xin Yu,Chongfeng Wang,Xinyi Chen
DOI: https://doi.org/10.1007/s11042-024-19128-5
IF: 2.577
2024-04-09
Multimedia Tools and Applications
Abstract:In this study, we present a novel algorithm aimed at detecting the grasping poses of target objects in the visual grasping process of robotic arms, specifically addressing challenges posed by insufficient lighting and low exposure. The proposed algorithm comprises of two key components: an image enhancement network designed for low-light scenes, and an object planar grasping pose detection network. To enhance the quality of images captured in low-light conditions, a comprehensive end-to-end image processing model named Multi-scale Context Residual Convolutional Network (MCRNet) is introduced. The model not only learns the features and representations of images, but also enhances its brightness, contrast, and details. It improves the overall enhancement effectiveness of low-light image. The enhanced images are subsequently fed into the Context Residual Convolutional Network (CRNet), which extracts crucial visual features and detects object planar grasping poses. To assess the performance of our approach, RGB-depth sensors are employed on two widely-used datasets: the Cornell Grasping Dataset and the Jacquard Grasping Dataset. The proposed algorithm achieves the grasping success rates of 93.22% and 90.22%, respectively. Furthermore, the effectiveness of our system in real-world low-light environments is validated by conducting robotic arm grasping experiments, the impressive grasping accuracy of 86% is achieved. Compared to scenarios without image enhancement, the proposed MCRNet low-light enhancement network significantly improves the grasp success rate of robotic arms operating under insufficient lighting conditions.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering