Abstract:To autonomously move and operate objects in cluttered indoor environments, a service robot requires the ability of 3D scene perception. Though 3D object detection can provide an object-level environmental description to fill this gap, a robot always encounters incomplete object observation, recurring detections of the same object, error in detection, or intersection between objects when conducting detection continuously in a cluttered room. To solve these problems, we propose a two-stage 3D object detection algorithm which is to fuse multiple views of 3D object point clouds in the first stage and to eliminate unreasonable and intersection detections in the second stage. For each view, the robot performs a 2D object semantic segmentation and obtains 3D object point clouds. Then, an unsupervised segmentation method called Locally Convex Connected Patches (LCCP) is utilized to segment the object accurately from the background. Subsequently, the Manhattan Frame estimation is implemented to calculate the main orientation of the object and subsequently, the 3D object bounding box can be obtained. To deal with the detected objects in multiple views, we construct an object database and propose an object fusion criterion to maintain it automatically. Thus, the same object observed in multi-view is fused together and a more accurate bounding box can be calculated. Finally, we propose an object filtering approach based on prior knowledge to remove incorrect and intersecting objects in the object dataset. Experiments are carried out on both SceneNN dataset and a real indoor environment to verify the stability and accuracy of 3D semantic segmentation and bounding box detection of the object with multi-view fusion.

A Fast 3D Object Recognition Pipeline in Cluttered and Occluded Scenes.

3D Object Recognition in Cluttered Scenes with Robust Shape Description and Correspondence Selection.

HCCG: Efficient high compatibility correspondence grouping for 3D object recognition and 6D pose estimation in cluttered scenes

Picking from Clutter: An Object Segmentation Method for Robot Grasping.

A Novel Occlusion-Free Active Recognition Algorithm for Objects in Clutter

Graspability-Aware Object Pose Estimation in Cluttered Scenes

Clutter Slices Approach for Identification-on-the-fly of Indoor Spaces

Marker-Less 3d Object Recognition and 6d Pose Estimation for Homogeneous Textureless Objects: An RGB-D Approach

Speedup 3-D Texture-Less Object Recognition Against Self-Occlusion for Intelligent Manufacturing

Smart Explorer: Recognizing Objects in Dense Clutter Via Interactive Exploration

GPR: Grasp Pose Refinement Network for Cluttered Scenes

Autonomous Object Segmentation In Cluttered Environment Through Interactive Perception

6D Object Pose Estimation in Cluttered Scenes from RGB Images

Towards Cross-device and Training-free Robotic Grasping in 3D Open World

Multi-scale deep learning and clustering-based tabletop object instance segmentation for robot manipulation

Real-time obj ect recognition and localization system for indoor service robot

3D attention-driven depth acquisition for object identification.

Efficient 3D Object Recognition for Unadjusted Bin Picking Automation

Deep Learning-Based Object Classification and Position Estimation Pipeline for Potential Use in Robotized Pick-and-Place Operations

Towards real-time object recognition and pose estimation in point clouds

Multi-View Fusion-Based 3D Object Detection for Robot Indoor Scene Perception