Abstract:The astounding development of optical sensing imaging technology, coupled with the impressive improvements in machine learning algorithms, has increased our ability to understand and extract information from scenic events. In most cases, Convolution neural networks (CNNs) are largely adopted to infer knowledge due to their surprising success in automation, surveillance, and many other application domains. However, the convolution operations' overwhelming computation demand has somewhat limited their use in remote sensing edge devices. In these platforms, real-time processing remains a challenging task due to the tight constraints on resources and power. Here, the transfer and processing of non-relevant image pixels act as a bottleneck on the entire system. It is possible to overcome this bottleneck by exploiting the high bandwidth available at the sensor interface by designing a CNN inference architecture near the sensor. This paper presents an attention-based pixel processing architecture to facilitate the CNN inference near the image sensor. We propose an efficient computation method to reduce the dynamic power by decreasing the overall computation of the convolution operations. The proposed method reduces redundancies by using a hierarchical optimization approach. The approach minimizes power consumption for convolution operations by exploiting the Spatio-temporal redundancies found in the incoming feature maps and performs computations only on selected regions based on their relevance score. The proposed design addresses problems related to the mapping of computations onto an array of processing elements (PEs) and introduces a suitable network structure for communication. The PEs are highly optimized to provide low latency and power for CNN applications. While designing the model, we exploit the concepts of biological vision systems to reduce computation and energy. We prototype the model in a Virtex UltraScale+ FPGA and implement it in Application Specific Integrated Circuit (ASIC) using the TSMC 90nm technology library. The results suggest that the proposed architecture significantly reduces dynamic power consumption and achieves high-speed up surpassing existing embedded processors' computational capabilities.

A Rank Decomposed Statistical Error Compensation Technique for Robust Convolutional Neural Networks in the Near Threshold Voltage Regime

Variation-Tolerant Architectures for Convolutional Neural Networks in the Near Threshold Voltage Regime

Error-Resilient Machine Learning in Near Threshold Voltage Via Classifier Ensemble.

Shavette: Low Power Neural Network Acceleration via Algorithm-level Error Detection and Undervolting

Algorithm-Based Fault Tolerance for Convolutional Neural Networks

Convolutional neural networks with low-rank regularization

AppSRAM: Incremental Retraining Method to Compensate for SRAM Failure in Voltage-Scaling Embedded CNN System

Low power Convolutional Neural Networks on a chip

Bit Error Robustness for Energy-Efficient DNN Accelerators

Holistic CNN Compression Via Low-Rank Decomposition with Knowledge Transfer.

Towards an Efficient CNN Inference Architecture Enabling In-Sensor Processing

Sensitivity-based Acceleration and Compression Algorithm for Convolution Neural Network.

A Low-Power Hardware Architecture for Real-Time CNN Computing

Speeding-up and compression convolutional neural networks by low-rank decomposition without fine-tuning

Incremental Training and Group Convolution Pruning for Runtime DNN Performance Scaling on Heterogeneous Embedded Platforms

RE-Specter: Examining the Architectural Features of Configurable CNN with Power Side-Channel

Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization

An Autonomous Error-Tolerant Architecture Featuring Self-reparation for Convolutional Neural Networks

Automatic Rank Selection for High-Speed Convolutional Neural Network

Designing DNNs for a trade-off between robustness and processing performance in embedded devices

AxR-NN: Approximate Computation Reuse for Energy-Efficient Convolutional Neural Networks