Abstract:Three-dimensional object detection utilizing LiDAR point cloud data is an indispensable part of autonomous driving perception systems. Point cloud-based 3D object detection has been a better replacement for higher accuracy than cameras during nighttime. However, most LiDAR-based 3D object methods work in a supervised manner, which means their state-of-the-art performance relies heavily on a large-scale and well-labeled dataset, while these annotated datasets could be expensive to obtain and only accessible in the limited scenario. Transfer learning is a promising approach to reduce the large-scale training datasets requirement, but existing transfer learning object detectors are primarily for 2D object detection rather than 3D. In this work, we utilize the 3D point cloud data more effectively by representing the birds-eye-view (BEV) scene and propose a transfer learning based point cloud semantic segmentation for 3D object detection. The proposed model minimizes the need for large-scale training datasets and consequently reduces the training time. First, a preprocessing stage filters the raw point cloud data to a BEV map within a specific field of view. Second, the transfer learning stage uses knowledge from the previously learned classification task (with more data for training) and generalizes the semantic segmentation-based 2D object detection task. Finally, 2D detection results from the BEV image have been back-projected into 3D in the postprocessing stage. We verify results on two datasets: the KITTI 3D object detection dataset and the Ouster LiDAR-64 dataset, thus demonstrating that the proposed method is highly competitive in terms of mean average precision (mAP up to 70%) while still running at more than 30 frames per second (FPS).

Label Transfer for Joint Recognition and Segmentation of 3D Object.

Multi-objects Real Time Recognition Based on Color Information

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

Cross-modal and Cross-domain Knowledge Transfer for Label-free 3D Segmentation

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Self-Supervised Learning of Object Segmentation from Unlabeled RGB-D Videos

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Image-driven Unsupervised 3D Model Co-Segmentation

Semi-supervised Learning for RGB-D Object Recognition.

Object segmentation using stereo images

Semi-Supervised Mesh Segmentation and Labeling

LDLS: 3-D Object Segmentation Through Label Diffusion From 2-D Images

Label Transfer Between Images And 3d Shapes Via Local Correspondence Encoding

RGB-D Semantic Segmentation and Label-Oriented Voxelgrid Fusion for Accurate 3D Semantic Mapping

Joint Global and Dynamic Pseudo Labeling for Semi-Supervised Point Cloud Sequence Segmentation

Detection Based Object Labeling of 3D Point Cloud for Indoor Scenes.

Joint Object Segmentation and Depth Upsampling

3D Texture Recognition for RGB-D Images.

From RGB-D Images to RGB Images: Single Labeling for Mining Visual Models

Transfer Learning Based Semantic Segmentation for 3D Object Detection from Point Cloud

3D Object Recognition By Corresponding and Quantizing Neural 3D Scene Representations