Abstract:An algorithm has been developed for fusing 3D LIDAR (Light Detection and Ranging) systems that receive objects detected in deep learning-based image sensors and object data in the form of 3D point clouds. 3D LIDAR represents 3D point data in a planar rectangular coordinate system with a 360° representation of the detected object surface, including the front face. However, only the direction and distance data of the object can be obtained, and point cloud data cannot be used to create a specific definition of the object. Therefore, only the movement of the point cloud data can be tracked using probability and classification algorithms based on image processing. To overcome this limitation, the study matches 3D LIDAR data with 2D image data through the fusion of hybrid level multi-sensors. First, because 3D LIDAR data represents all objects in the sensor's detection range as dots, all unnecessary data, including ground data, is filtered out. The 3D Random Sample Consensus (RANSAC) algorithm enables the extraction of ground data perpendicular to the reference estimation 3D plane and data at both ends through ground estimation. Classified environmental data facilitates the labeling of all objects within the viewing angle of 3D LIDAR based on the presence or absence of movement. The path of motion of the platform can be established by detecting whether objects within the region of interest are movable or static. Because LIDAR is based on 8- and 16-channel rotation mechanisms, real-time data cannot be used to define objects. Instead, point clouds can be used to detect obstacles in the image through deep learning in the preliminary processing phase of the classification algorithm. By matching the labeling information of defined objects with the classified object cloud data obtained using 3D LIDAR, the exact dynamic trajectory and position of the defined objects can be calculated. Consequently, to process the acquired object data effic-ently, we devised an active-region-of-interest technique to ensure a fast processing speed while maintaining a high detection rate.

3D object recognition method with multiple feature extraction from LiDAR point clouds

3D LiDAR-Based Global Localization Using Siamese Neural Network

MS23D: A 3D object detection method using multi-scale semantic feature points to construct 3D feature layer

PV-SSD: A Multi-Modal Point Cloud Feature Fusion Method for Projection Features and Variable Receptive Field Voxel Features

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

A 3D Object Recognition Method From LiDAR Point Cloud Based on USAE-BLS

Spatial Information Enhancement with Multi-Scale Feature Aggregation for Long-Range Object and Small Reflective Area Object Detection from Point Cloud

3D Instance Segmentation and Object Detection Framework Based on the Fusion of Lidar Remote Sensing and Optical Image Sensing

Research on 3D Point Cloud Object Detection Algorithm for Autonomous Driving

Object Recognition Based Interpolation With 3D LIDAR and Vision for Autonomous Driving of an Intelligent Vehicle

Three-Dimensional Point Cloud Object Detection Based on Feature Fusion and Enhancement

Multi-scale Feature Fusion with Point Pyramid for 3D Object Detection

Combined Edge- and Stixel-based Object Detection in 3D Point Cloud

Region-proposal Convolutional Network-driven Point Cloud Voxelization and Over-segmentation for 3D Object Detection

3D Point Cloud Recognition Based on a Multi-View Convolutional Neural Network

CFPC: The Curbed Fake Point Collector to Pseudo-LiDAR-Based 3D Object Detection for Autonomous Vehicles

Sparse 3D point clouds segmentation considering 2D image feature extraction with deep learning

LiDAR‐based place recognition for mobile robots in ground/water surface multiple scenes

DGCB-Net: Dynamic Graph Convolutional Broad Network for 3D Object Recognition in Point Cloud

A Novel CNN Architecture for Real-Time Point Cloud Recognition in Road Environment