Abstract:Deep neural networks (DNNs), as the basis of object detection, will play a key role in the development of future autonomous systems with full autonomy. The autonomous systems have special requirements of real-time, energy-e cient implementations of DNNs on a power-budgeted system. Two research thrusts are dedicated to per- formance and energy e ciency enhancement of the inference phase of DNNs. The first one is model compression techniques while the second is e cient hardware implementations. Recent researches on extremely-low-bit CNNs such as binary neural network (BNN) and XNOR-Net replace the traditional oating point operations with bi- nary bit operations, signi cantly reducing memory bandwidth and storage requirement, whereas suffering non-negligible accuracy loss and waste of digital signal processing (DSP) blocks on FPGAs. To overcome these limitations, this paper proposes REQ-YOLO, a resource aware, systematic weight quantization framework for object detection, considering both algorithm and hardware resource aspects in object detection. We adopt the block-circulant matrix method and propose a heterogeneous weight quantization using Alternative Direction Method of Multipliers (ADMM), an e ective optimization technique for general, non-convex optimization problems. To achieve real-time, highly efficient implementations on FPGA, we present the detailed hardware implementation of block circulant matrices on CONV layers and de- velop an e cient processing element (PE) structure supporting the heterogeneous weight quantization, CONV data ow and pipelining techniques, design optimization, and a template-based automatic synthesis framework to optimally exploit hardware resource. Experimental results show that our proposed REQ-YOLO framework can signi cantly compress the YOLO model while introducing very small accuracy degradation. The related codes are here: https://github.com/Anonymous788/heterogeneous_ADMM_YOLO.

A biologically-inspired network for generic object recognition using CUDA

Where-What Network With Cuda: General Object Recognition And Location In Complex Backgrounds

A social network-aware top-N recommender system using GPU.

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

An Event-Driven Computational System With Spiking Neurons For Object Recognition

Hierarchical Gate Network for Fine-Grained Visual Recognition.

HB-net: Holistic bursting cell cluster integrated network for occluded multi-objects recognition

Brain-inspired multimodal hybrid neural network for robot place recognition

Object Detection Implementation and Optimization on Embedded GPU System.

A Bio-Inspired Hierarchical Spiking Neural Network With Reward-Modulated STDP Learning Rule for AER Object Recognition

A Framework for Fast Scalable BNN Inference using Googlenet and Transfer Learning

Object Detection based on Cortex Hierarchical Activation in Border Sensitive Mechanism and Classification-GIoU Joint Representation

Deep Regionlets: Blended Representation and Deep Learning for Generic Object Detection

Realization of CUDA-based Real-Time Registration and Target Localization for High-Resolution Video Images

A High-Throughput Screening Approach to Discovering Good Forms of Biologically Inspired Visual Representation

[A bio-inspired hierarchical spiking neural network with biological synaptic plasticity for event camera object recognition].

Object detection and recognition of intelligent service robot based on deep learning

The Architecture and Recognition Algorithm in Haibao Perceptual Development Robot

REQ-YOLO

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition

On-Board Small-Scale Object Detection for Unmanned Aerial Vehicles (UAVs)