Abstract:Fast object tracking on embedded devices is of great importance for applications such as autonomous driving, unmanned aerial vehicle, and intelligent monitoring. Whereas, most of previous general solutions failed to reach this goal due to the facts that (i) high computational complexity and heterogeneous operation steps in the tracking models and (ii) parallelism-limited and bloated hardware platforms (e.g., CPU/GPU). Although previously proposed devices leverage neural dynamics and near-data processing for efficient tracking, their flexibility is limited due to the tight integration with vision sensor and the effectiveness on various video datasets is yet to be fully demonstrated. On the other side, recently the many-core architecture with massive parallelism and optimized memory locality is being widely applied to improve the performance for flexibly executing neural networks. This motivates us to adapt and map an object tracking model based on attractor neural networks with continuous and smooth attractor dynamics onto neural network chips for fast tracking. In order to make the model hardware friendly, we add local-connection restriction. We analyze the tracking accuracy and observe that the model achieves comparable results on typical video datasets. Then, we design a many-core neural network architecture with several computation and transformation operations to support the model. Moreover, by discretizing the continuous dynamics to the corresponding discrete counterpart, designing a slicing scheme for efficient topology mapping, and introducing a constant-restricted scaling chain rule for data quantization, we build a complete mapping framework to implement the tracking model on the many-core architecture. We fabricate a many-core neural network chip to evaluate the real execution performance. Results show that a single chip is able to accommodate the whole tracking model, and a fast tracking speed of nearly 800 FPS (frames per second) can be achieved. This work enables high-speed object tracking on embedded devices which normally have limited resources and energy.

A Manycore Processor Based Multilayer Perceptron Feedforward Acceleration Framework for Embedded System

DaDianNao: A Machine-Learning Supercomputer

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

An Object Detection Acceleration Framework Based On Low-Power Heterogeneous Manycore Architecture

A deep learning image recognition framework accelerator based parallel computing

Novel many-core architecture design for real-time image processing

A Deep Learning Frame on Embedded Multicore Processors Based on Caffe and Its Parallel Implementation

Optimized Parallel Implementation of Face Detection Based on Embedded Heterogeneous Many-Core Architecture

An Energy-Efficient Deep Belief Network Processor Based on Heterogeneous Multi-Core Architecture With Transposable Memory and On-Chip Learning

A Parallel Processing CNN Accelerator on Embedded Devices Based on Optimized MobileNet

An Efficient Parallel CNN Inference Framework for Multi-zone Processor

Accelerating Hybrid And Compact Neural Networks Targeting Perception And Control Domains With Coarse-Grained Dataflow Reconfiguration

A Scalable Object Detection Framework Based on Embedded Manycore Cluster

Embedded Streaming Deep Neural Networks Accelerator With Applications

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

Design Implementation of FPGA-Based Neural Network Acceleration

Fast Object Tracking on a Many-Core Neural Network Chip

An ASIP for Neural Network Inference on Embedded Devices with 99% PE Utilization and 100% Memory Hidden under Low Silicon Cost.

Design an Efficient DNN Inference Framework with PS-PL Synergies in FPGA for Edge Computing

A neural network accelerator for mobile application processors

OCEAN: an On-Chip Incremental-Learning Enhanced Processor with Gated Recurrent Neural Network Accelerators.