Abstract:To understand driving environments effectively, it is important to achieve accurate detection and classification of objects detected by sensor-based intelligent vehicle systems, which are significantly important tasks. Object detection is performed for the localization of objects, whereas object classification recognizes object classes from detected object regions. For accurate object detection and classification, fusing multiple sensor information into a key component of the representation and perception processes is necessary. In this paper, we propose a new object-detection and classification method using decision-level fusion. We fuse the classification outputs from independent unary classifiers, such as 3D point clouds and image data using a convolutional neural network (CNN). The unary classifiers for the two sensors are the CNN with five layers, which use more than two pre-trained convolutional layers to consider local to global features as data representation. To represent data using convolutional layers, we apply region of interest (ROI) pooling to the outputs of each layer on the object candidate regions generated using object proposal generation to realize color flattening and semantic grouping for charge-coupled device and Light Detection And Ranging (LiDAR) sensors. We evaluate our proposed method on a KITTI benchmark dataset to detect and classify three object classes: cars, pedestrians and cyclists. The evaluation results show that the proposed method achieves better performance than the previous methods. Our proposed method extracted approximately 500 proposals on a 1226 × 370 image, whereas the original selective search method extracted approximately 10 6 × n proposals. We obtained classification performance with 77.72% mean average precision over the entirety of the classes in the moderate detection level of the KITTI benchmark dataset.

Multi-target Classification Method Based on the Fusion of HOG and SURF Features

Source Cell-phone Identification Based on Multi-feature Fusion.

Small Low-Contrast Target Detection: Data-Driven Spatiotemporal Feature Fusion and Implementation

Fast Target Recognition Method Based on Multi-Scale Fusion and Deep Learning

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

The Realistic Fusion of Multi-spectral Images

Multi-target tracking algorithm based on the multi-feature fusion matching and Hough forest

Multi-Modal Target Detection Method Based on Adaptive Feature Search

Image classification based on support vector machine and the fusion of complementary features

Multi-object Tracking Via MHT with Multiple Information Fusion in Surveillance Video

Long-Term Tracking Algorithm with the Combination of Multi-feature Fusion and YOLO.

3D Dynamic Multi-target Detection Algorithm Based on Cross-view Feature Fusion

Blur Detection Using Multi-method Fusion.

Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Tracking

Multi-Modal Object Detection Method Based on Dual-Branch Asymmetric Attention Backbone and Feature Fusion Pyramid Network

MMLF: Multi-modal Multi-class Late Fusion for Object Detection with Uncertainty Estimation

HATF: Multi-Modal Feature Learning for Infrared and Visible Image Fusion via Hybrid Attention Transformer

An efficient real-time target tracking algorithm using adaptive feature fusion

An online learned hough forest model based on improved multi-feature fusion matching for multi-object tracking

Informative Data Selection with Uncertainty for Multi-modal Object Detection

Object Detection and Classification by Decision-Level Fusion for Intelligent Vehicle Systems