Abstract:This paper aims at developing a faster and more accurate solution to the amodal 3D object detection problem for indoor scenarios. The solution is achieved through a novel neural network structure which takes a pair of RGB-D images as input and delivers oriented 3D bounding boxes as the output. Such network, named 3D-SSD, has two components: hierarchical feature fusion and multi-layer prediction. The hierarchical feature fusion combines multi-scale appearance and geometric features learned from RGB-D images, which is later utilized in the multi-layer prediction for object detection. Both the accuracy and the efficiency can be improved by exploiting 2.5D representations in a synergistic way. To specifically address the shape variance of different objects, a set of 3D anchor boxes with varying physical sizes are attached to every location on the prediction layers. While testing, the category scores for 3D anchor boxes are generated with adjusted positions, sizes and orientations, leading to the final detections using non-maximum suppression. Comprehensive experiments have been performed on publicly accessible dataset of SUN RGB-D and NYUV2. The results show the proposed algorithm is the first 3D detector that runs in near real-time on the challenging datasets with competitive performance to the state-of-the-art methods. The 3D-SSD gets 37.1% mAP on the SUN RGB-D dataset at around 5.6 fps, which outperforms the state-of-the-art Deep Sliding Shape by 10.2% mAP and around 109 x faster. For an efficient model setting with a rate of 9.3 fps, 3D-SSD still gets an accuracy of 37% on mAP. Further, experiments also suggest the proposed approach achieves comparable accuracy and is about 477 x faster than the state-of-art method on the NYUv2 dataset even with a smaller input image size. (C) 2019 Published by Elsevier B.V.

Efficient 2D-to-3D Correspondence Filtering for Scalable 3D Object Recognition

3D Object Recognition by Fast Spherical Correlation Between Combined View EGIs and PFT.

3D-SSD: Learning Hierarchical Features from RGB-D Images for Amodal 3D Object Detection

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

Robust 3D Face Recognition by Local Shape Difference Boosting

HCCG: Efficient high compatibility correspondence grouping for 3D object recognition and 6D pose estimation in cluttered scenes

Efficient 3D Object Recognition from Cluttered Point Cloud

Face recognition via fast dense correspondence

Efficient Covisibility-based Image Matching for Large-Scale SfM

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

A Coarse-to-Fine Algorithm for Matching and Registration in 3D Cross-Source Point Clouds

Fast Object Retrieval Using Direct Spatial Matching

Combining Local Descriptions With Geometric Constraints For 3-D Object Recognition In Multiple Statuses

Efficient Dynamic Correspondence Network

3D Object Recognition By Corresponding and Quantizing Neural 3D Scene Representations

Neighbor-Vote: Improving Monocular 3D Object Detection through Neighbor Distance Voting

6D object pose estimation based on dense convolutional object center voting with improved accuracy and efficiency

OCM3D: Object-Centric Monocular 3D Object Detection

Speedup 3-D Texture-Less Object Recognition Against Self-Occlusion for Intelligent Manufacturing

An Efficient Ungrouped Mask Method with Two Learnable Parameters for 3D Object Detection

3D object recognition method with multiple feature extraction from LiDAR point clouds