Abstract:Accurate object classification and position estimation is a crucial part of executing autonomous pick-and-place operations by a robot and can be realized using RGB-D sensors becoming increasingly available for use in industrial applications. In this paper, we present a novel unified framework for object detection and classification using a combination of point cloud processing and deep learning techniques. The proposed model uses two streams that recognize objects on RGB and depth data separately and combines the two in later stages to classify objects. Experimental evaluation of the proposed model including classification accuracy compared with previous works demonstrates its effectiveness and efficiency, making the model suitable for real-time applications. In particular, the experiments performed on the Washington RGB-D object dataset show that the proposed framework has 97.5% and 95% fewer parameters compared to the previous state-of-the-art multimodel neural networks Fus-CNN, CNN Features and VGG3D, respectively, with the cost of approximately 5% drop in classification accuracy. Moreover, the inference of the proposed framework takes 66.11%, 32.65%, and 28.77% less time on GPU and 86.91%, 51.12%, and 50.15% less time on CPU in comparison to VGG3D, Fus-CNN, and CNN Features. The potential applicability of the developed object classification and position estimation framework was then demonstrated on an experimental robot-manipulation setup realizing a simplified object pick-and-place scenario. In approximately 95% of test trials, the system was able to accurately position the robot over the detected objects of interest in an automatic mode, ensuring stable cyclic execution with no time delays.

A Sim-to-Real Object Recognition and Localization Framework for Industrial Robotic Bin Picking

An Improved Supervoxel Clustering Algorithm of 3D Point Clouds for the Localization of Industrial Robots

Deep Learning-Based Object Classification and Position Estimation Pipeline for Potential Use in Robotized Pick-and-Place Operations

Towards Robust Part-aware Instance Segmentation for Industrial Bin Picking

Deep Workpiece Region Segmentation for Bin Picking

DBPF: A Framework for Efficient and Robust Dynamic Bin-Picking

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

Fast and Robust Bin-picking System for Densely Piled Industrial Objects

Bin-picking of novel objects through category-agnostic-segmentation: RGB matters

Fully Convolutional One-Shot Object Segmentation for Industrial Robotics

Robotic picking in dense clutter via domain invariant learning from synthetic dense cluttered rendering

Deep-Learning-Based Accurate Identification of Warehouse Goods for Robot Picking Operations

Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching

Spot-Compose: A Framework for Open-Vocabulary Object Retrieval and Drawer Manipulation in Point Clouds

Two-Stage Grasping: A New Bin Picking Framework for Small Objects

DoraPicker: An Autonomous Picking System for General Objects

6D Object Localization in Car-Assembly Industrial Environment

Towards One Shot & Pick All: 3D-OAS, an end-to-end framework for vision guided top-down parcel bin-picking using 3D-overlapping-aware instance segmentation and GNN

PS6D: Point Cloud Based Symmetry-Aware 6D Object Pose Estimation in Robot Bin-Picking

A Deep Hierarchical Framework for Robot Global Localization