Abstract:Deep neural networks (DNNs) are a type of artificial intelligence models that are inspired by the structure and function of the human brain, designed to process and learn from large amounts of data, making them particularly well-suited for tasks such as image and speech recognition. However, applications of DNNs are experiencing emerging growth due to the deployment of specialized accelerators such as the Google Tensor Processing Units (TPUs). In large-scale deployments, the energy efficiency of such accelerators may become a critical concern. In the voltage overscaling (VOS) technique, the operating voltage of the system is scaled down beyond the nominal operating voltage, which increases the energy efficiency and lifetime of digital circuits. The VOS technique is usually performed without changing the frequency resulting in timing errors. However, some applications such as multimedia processing, including DNNs, have intrinsic resilience against errors and noise. In this paper, we exploit the inherent resilience of DNNs to propose a quality-aware voltage overscaling framework for TPUs, named X-TPU, which offers higher energy efficiency and lifetime compared to conventional TPUs. The X-TPU framework is composed of two main parts, a modified TPU architecture that supports a runtime voltage overscaling, and a statistical error modeling-based algorithm to determine the voltage of neurons such that the output quality is retained above a given user-defined quality threshold. We synthesized a single-neuron architecture using a 15-nm FinFET technology under various operating voltage levels. Then, we extracted different statistical error models for a neuron corresponding to those voltage levels. Using these models and the proposed algorithm, we determined the appropriate voltage of each neuron. Results show that running a DNN on X-TPU can achieve 32% energy saving for only 0.6% accuracy loss.

An error-resilient wavelet-based ECG processor under voltage overscaling

An Area-Efficient Error-Resilient Ultralow-Power Subthreshold ECG Processor

A Dual-Mode ECG Processor with Difference-Insensitive QRS Detection and Lossless Compression

A Lifting Wavelet Based Lossless and Lossy ECG Compression Processor for Wireless Sensors

A Low Power Qrs Detection Processor With Adaptive Scaling Of Processing Resolution

Margin Elimination in a 55 nm Near-Threshold Microcontroller with Adaptive Prediction Capability and Voltage Scaling

Low-power perceptron model based ECG processor for premature ventricular contraction detection.

A Highly Adaptive Lossless ECG Compression ASIC for Wireless Sensors Based on Hybrid Gomlomb Coding.

An Energy-Efficient ECG Processor with Weak-Strong Hybrid Classifier for Arrhythmia Detection

A Lossless Electrocardiogram Compression System Based on Dual-Mode Prediction and Error Modeling.

A Near Threshold Error Resilient Processor Based on Dynamic Timing Error Prediction and Within-a-cycle Timing Error Correction

An Energy-Efficient ECG Processor with Ultra-Low-Parameter Multi-Stage Neural Network and Optimized Power-of-Two Quantization

Negative Design Margin Realization through Deep Path Activity Detection Combined with Dynamic Voltage Scaling in a 55 nm Near-Threshold 32-Bit Microcontroller

A 410-nW Efficient QRS Processor for Mobile ECG Monitoring in 0.18-μm CMOS

An Energy-Efficient Microprocessor Using Multilevel Error Correction For Timing Error Tolerance

A 17.7-Pj/cycle ECG Processor for Arrhythmia Detection with High Immunity to Power Line Interference and Baseline Drift

A Variation-Tolerant Near-Threshold Processor with Instruction-Level Error Correction

Eliminating Timing Errors Through Collaborative Design to Maximize the Throughput

An Energy-Efficient Design for ECG Recording and R-Peak Detection Based on Wavelet Transform

Error-Resilient Integrated Clock Gate for Clock-Tree Power Optimization on a Wide Voltage IOT Processor

A Quality-Aware Voltage Overscaling Framework to Improve the Energy Efficiency and Lifetime of TPUs based on Statistical Error Modeling