Abstract:Real-time accurate detection of three-dimensional (3D) objects is a fundamental necessity for self-driving vehicles. Most existing computer vision approaches are based on convolutional neural networks (CNNs). Although the CNN-based approaches can achieve high detection accuracy, their high energy consumption is a severe drawback. To resolve this problem, novel energy efficient approaches should be explored. Spiking neural network (SNN) is a promising candidate because it has orders-of-magnitude lower energy consumption than CNN. Unfortunately, the studying of SNN has been limited in small networks only. The application of SNN for large 3D object detection networks has remain largely open. In this paper, we integrate spiking convolutional neural network (SCNN) with temporal coding into the YOLOv2 architecture for real-time object detection. To take the advantage of spiking signals, we develop a novel data preprocessing layer that translates 3D point-cloud data into spike time data. We propose an analog circuit to implement the non-leaky integrate and fire neuron used in our SCNN, from which the energy consumption of each spike is estimated. Moreover, we present a method to calculate the network sparsity and the energy consumption of the overall network. Extensive experiments have been conducted based on the KITTI dataset, which show that the proposed network can reach competitive detection accuracy as existing approaches, yet with much lower average energy consumption. If implemented in dedicated hardware, our network could have a mean sparsity of 56.24% and extremely low total energy consumption of 0.247mJ only. Implemented in NVIDIA GTX 1080i GPU, we can achieve 35.7 fps frame rate, high enough for real-time object detection.

Neural Network Architecture Based on Wavelet Transform for Electro-mobility Detection

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

Fast and Accurate Object Detection in Remote Sensing Images Based on Lightweight Deep Neural Network

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

WAVE: Edge-Device Cooperated Real-time Object Detection for Open-air Applications

Detecting The Objects on The Road Using Modular Lightweight Network

An End-to-End Practice of Remote Sensing Object Detection with NVIDIA Embedded System

Spiking Neural Network for Fourier Transform and Object Detection for Automotive Radar

An Effective and Lightweight Hybrid Network for Object Detection in Remote Sensing Images

Efficient Visual Fault Detection for Freight Train via Neural Architecture Search with Data Volume Robustness

Deep SCNN-based Real-time Object Detection for Self-driving Vehicles Using LiDAR Temporal Data

Anomaly Detection for Automated Vehicles Integrating Continuous Wavelet Transform and Convolutional Neural Network

Long-Range Thermal Target Detection in Data-Limited Settings Using Restricted Receptive Fields

Fuzzy wavelet neural network driven vehicle detection on remote sensing imagery

ELWNet: An Extremely Lightweight Approach for Real-Time Salient Object Detection

Meta-neural-network for real-time and passive deep-learning-based object recognition

WCNN3D: Wavelet Convolutional Neural Network-Based 3D Object Detection for Autonomous Driving

Object Detection in Aerial Navigation using Wavelet Transform and Convolutional Neural Networks: A First Approach

Spatial Information Enhancement with Multi-Scale Feature Aggregation for Long-Range Object and Small Reflective Area Object Detection from Point Cloud

LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

A Fast Intrusion Detection Method for High-Speed Railway Clearance Based on Low-Cost Embedded GPUs