Abstract:Indoor environment is a common scene in our everyday life, and detecting and tracking multiple targets in this environment is a key component for many applications. However, this task still remains challenging due to limited space, intrinsic target appearance variation, e. g. full or partial occlusion, large pose deformation, and scale change. In the proposed approach, we give a novel framework for detection and tracking in indoor environments, and extend it to robot navigation. One of the key components of our approach is a virtual top view created from an RGB-D camera, which is named ground plane projection (GPP). The key advantage of using GPP is the fact that the intrinsic target appearance variation and extrinsic noise is far less likely to appear in GPP than in a regular side-view image. Moreover, it is a very simple task to determine free space in GPP without any appearance learning even from a moving camera. Hence GPP is very different from the top-view image obtained from a ceiling mounted camera. We perform both object detection and tracking in GPP. Two kinds of GPP images are utilized: gray GPP, which represents the maximal height of 3D points projecting to each pixel, and binary GPP, which is obtained by thresholding the gray GPP. For detection, a simple connected component labeling is used to detect footprints of targets in binary GPP. For tracking, a novel Pixel Level Association (PLA) strategy is proposed to link the same target in consecutive frames in gray GPP. It utilizes optical flow in gray GPP, which to our best knowledge has never been done before. Then we "back project" the detected and tracked objects in GPP to original, sideview (RGB) images. Hence we are able to detect and track objects in the side-view (RGB) images. Our system is able to robustly detect and track multiple moving targets in real time. The detection process does not rely on any target model, which means we do not need any training process. Moreover, tracking does not require any manual initialization, since all entering objects are robustly detected. We also extend the novel framework to robot navigation by tracking. As our experimental results demonstrate, our approach can achieve near prefect detection and tracking results. The performance gain in comparison to state-of-the-art trackers is most significant in the presence of occlusion and background clutter.

3-D Laser-Based Multiclass and Multiview Object Detection in Cluttered Indoor Scenes

Using Scale Coordination and Semantic Information for Robust 3-D Object Recognition by a Service Robot

Multi-View Fusion-Based 3D Object Detection for Robot Indoor Scene Perception

2D-to-3D Projection for Monocular and Multi-View 3D Multi-class Object Detection in Indoor Scenes

A Fast 3D Object Recognition Pipeline in Cluttered and Occluded Scenes.

Detection Based Object Labeling of 3D Point Cloud for Indoor Scenes.

From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detection

Multi-Channel Convolutional Neural Network Based 3D Object Detection for Indoor Robot Environmental Perception

Multi-Class Detection and Segmentation of Objects in Depth

Online Multiple Targets Detection and Tracking from Mobile Robot in Cluttered Indoor Environments with Depth Camera

3D Object Detection Based on Extremely Sparse Laser Point Cloud and RGB Images

A novel approach based on cluster-group for classification of 3D residential scene

Learning Occupancy for Monocular 3D Object Detection

Training an Open-Vocabulary Monocular 3D Object Detection Model without 3D Data

Deep Learning based 3D Object Detection in Indoor Environments: A Review

3-D Point Cloud Object Detection Based on Supervoxel Neighborhood with Hough Forest Framework

3D Fast Object Detection Based on Discriminant Images and Dynamic Distance Threshold Clustering

Indoor Target Detection and Pose Estimation Based on Point Cloud

Three-Dimensional Point Cloud Object Detection Based on Feature Fusion and Enhancement