Abstract:Reduced voltage operation is an effective technique for substantial energy efficiency improvement in digital circuits. This brief introduces a simple approach for enabling reduced voltage operation of Deep Neural Network (DNN) accelerators by mere software modifications. Conventional approaches for enabling reduced voltage operation e.g., Timing Error Detection (TED) systems, incur significant development costs and overheads, while not being applicable to the off-the-shelf components. Contrary to those, the solution proposed in this paper relies on algorithm-based error detection, and hence, is implemented with low development costs, does not require any circuit modifications, and is even applicable to commodity devices. By showcasing the solution through experimenting on popular DNNs, i.e., LeNet and VGG16, on a GPU platform, we demonstrate 18% to 25% energy saving with no accuracy loss of the models and negligible throughput compromise (< 3.9%), considering the overheads from integration of the error detection schemes into the DNN. The integration of presented algorithmic solution into the design is simpler when compared conventional TED based techniques that require extensive circuit-level modifications, cell library characterizations or special support from the design tools.

An Energy-Efficient Voice Activity Detector Using Deep Neural Networks and Approximate Computing.

A Background Noise Self-adaptive VAD Using SNR Prediction Based Precision Dynamic Reconfigurable Approximate Computing

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

EERA-ASR: an Energy-Efficient Reconfigurable Architecture for Automatic Speech Recognition with Hybrid DNN and Approximate Computing

VoAD: A Sub-μW Multiscene Voice Activity Detector Deploying Analog-Frontend Digital-Backend Circuits

An energy-efficient voice activity detector using reconfigurable Gaussian base normalization deep neural network

An Energy-efficient Reconfigurable Hybrid DNN Architecture for Speech Recognition with Approximate Computing.

sVAD: A Robust, Low-Power, and Light-Weight Voice Activity Detection with Spiking Neural Networks

A Low Power DNN-based Speech Recognition Processor with Precision Recoverable Approximate Computing

A Real-Time Voice Activity Detection Based On Lightweight Neural

Background Noise Adaptive Energy-Efficient Keywords Recognition Processor with Reusable DNN and Reconfigurable Architecture

Deep Learning Approaches for Voice Activity Detection

Voice Activity Detection Based on Time-Delay Neural Networks

DNN-based Voice Activity Detection for Speaker Recognition

Spiking neural networks trained with backpropagation for low power neuromorphic implementation of voice activity detection

Phase Aware Deep Neural Network For Noise Robust Voice Activity Detection

Binarized Weight Neural-Network Inspired Ultra-Low Power Speech Recognition Processor with Time-Domain Based Digital-Analog Mixed Approximate Computing

An Energy-Efficient Time-Domain Binary Neural Network Accelerator with Error-Detection in 28nm CMOS

A Universal VAD Based on Jointly Trained Deep Neural Networks.

Shavette: Low Power Neural Network Acceleration via Algorithm-level Error Detection and Undervolting

Reconfigurable Approximate Multiplication Architecture for CNN-Based Speech Recognition Using Wallace Tree Tensor Multiplier Unit