Abstract:Three-dimensional object detection is a pivotal research topic in computer vision, aiming to identify and locate objects in three-dimensional space. It has wide applications in various fields such as geoscience, autonomous driving, and drone navigation. The rapid development of deep learning techniques has led to significant advancements in 3D object detection. However, with the increasing complexity of applications, 3D object detection faces a series of challenges such as data imbalance and the effectiveness of network models. Specifically, in an experiment, our investigation revealed a notable discrepancy in the LiDAR reflection intensity within a point cloud scene, with stronger intensities observed in proximity and weaker intensities observed at a distance. Furthermore, we have also noted a substantial disparity in the number of foreground points compared to the number of background points. Especially in 3D object detection, the foreground point is more important than the background point, but it is usually downsampled without discrimination in the subsequent processing. With the objective of tackling these challenges, we work from both data and network perspectives, designing a feature alignment filtering algorithm and a two-stage 3D object detection network. Firstly, in order to achieve feature alignment, we introduce a correction equation to decouple the relationship between distance and intensity and eliminate the attenuation effect of intensity caused by distance. Then, a background point filtering algorithm is designed by using the aligned data to alleviate the problem of data imbalance. At the same time, we take into consideration the fact that the accuracy of semantic segmentation plays a crucial role in 3D object detection. Therefore, we propose a two-stage deep learning network that integrates spatial and spectral information, in which a feature fusion branch is designed and embedded in the semantic segmentation backbone. Through a series of experiments on the KITTI dataset, it is proven that the proposed method achieves the following average precision (AP_R40) values for easy, moderate, and hard difficulties, respectively: car (Iou 0.7)—89.23%, 80.14%, and 77.89%; pedestrian (Iou 0.5)—52.32%, 45.47%, and 38.78%; and cyclist (Iou 0.5)—76.41%, 61.92%, and 56.39%. By emphasizing both data quality optimization and efficient network architecture, the performance of the proposed method is made comparable to other state-of-the-art methods.

Multi-class Object Detection in Tunnels from 3D Point Clouds: an Auto-Optimized Lazy Learning Approach

Efficient 3D LIDAR Based Loop Closing Using Deep Neural Network

An encoder-decoder deep learning method for multi-class object segmentation from 3D tunnel point clouds

Semi-supervised learning-based point cloud network for segmentation of 3D tunnel scenes

Deep learning for large-scale point cloud segmentation in tunnels considering causal inference

Sewer defect instance segmentation, localization, and 3D reconstruction for sewer floating capsule robots

A Point Cloud Segmentation Method for Dim and Cluttered Underground Tunnel Scenes Based on the Segment Anything Model

Structure Aware Single-Stage 3D Object Detection From Point Cloud

Equal Emphasis on Data and Network: A Two-Stage 3D Point Cloud Object Detection Algorithm with Feature Alignment

Tunnel linings inspection using Bayesian-Optimized (BO) calibration of multiple Line-Scan Cameras (LSCs) and a Laser Range Finder (LRF)

Combining Cylindrical Voxel and Mask R-CNN for Automatic Detection of Water Leakages in Shield Tunnel Point Clouds

Batched-image detection model and deployment method for tunnel lining defects using line-scan cameras based on experiments study

Towards A Weakly Supervised Framework for 3D Point Cloud Object Detection and Annotation

A weakly supervised method for 3D object detection with partially annotated samples

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

Deep learning‐based object identification with instance segmentation and pseudo‐LiDAR point cloud for work zone safety

3D Object Detection Combining Semantic and Geometric Features from Point Clouds

GL-Net: Semantic segmentation for point clouds of shield tunnel via global feature learning and local feature discriminative aggregation

MANet: End-to-End Learning for Point Cloud Based on Robust Pointpillar and Multiattention

Automatic Detection Method of Sewer Pipe Defects Using Deep Learning Techniques

Long-range attention classification for substation point cloud