Abstract:There is much interest in incorporating inference capabilities into sensor-rich embedded platforms such as autonomous vehicles, wearables, and others. A central problem in the design of such systems is the need to extract information locally from sensed data on a severely limited energy budget. This necessitates the design of energy-efficient sensory embedded system. A typical sensory embedded system enforces a physical separation between sensing and computational subsystems - a separation mandated by the differing requirements of the sensing and computational functions. As a consequence, the energy consumption in such systems tends to be dominated by the energy consumed in transferring data over the sensor-processor interface (communication energy) and the energy consumed in processing the data in digital processor (computational energy). In this article, we propose an in-sensor computing architecture which (mostly) eliminates the sensor-processor interface by embedding inference computations in the noisy sensor fabric in analog and retraining the hyperparameters in order to compensate for non-ideal computations. The resulting architecture referred to as the Compute Sensor - a sensor that computes in addition to sensing - represents a radical departure from the conventional. We show that a Compute Sensor for image data can be designed by embedding both feature extraction and classification functions in the analog domain in close proximity to the CMOS active pixel sensor (APS) array. Significant gains in energy-efficiency are demonstrated using behavioral and energy models in a commercial semiconductor process technology. In the process, the Compute Sensor creates a unique opportunity to develop machine learning algorithms for information extraction from data on a noisy underlying computational fabric.

In-sensor neural network for high energy efficiency analog-to-information conversion

Input-Feature Correlated Asynchronous Analog to Information Converter for ECG Monitoring

Towards Flexible and Low-Power Wireless Smart Sensors: Reconfigurable Analog-to-Feature Conversion for Healthcare Applications

An Energy-Efficient Configurable Coprocessor Based on 1-D CNN for ECG Anomaly Detection

EKGNet: A 10.96μW Fully Analog Neural Network for Intra-Patient Arrhythmia Classification

An Energy-Efficient and Robust SNN Classifier for LC-ADC Sampled ECG Signals

Selective and Compressive Sensing for Energy-Efficient Implantable Neural Decoding.

A Neural Network-Based ECG Classification Processor with Exploitation of Heartbeat Similarity

AnalogNet: Convolutional Neural Network Inference on Analog Focal Plane Sensor Processors

A 0.99-to-4.38 Uj/class Event-Driven Hybrid Neural Network Processor for Full-Spectrum Neural Signal Analyses

An Analog-Memoryless Near Sensor Computing Architecture for Always-On Intelligent Perception Applications

A Neuromorphic Processing System for Low-Power Wearable ECG Classification.

e-G2C: A 0.14-to-8.31 $μ$J/Inference NN-based Processor with Continuous On-chip Adaptation for Anomaly Detection and ECG Conversion from EGM

An Energy-Efficient ECG Processor with Ultra-Low-Parameter Multi-Stage Neural Network and Optimized Power-of-Two Quantization

An Event-Driven Compressive Neuromorphic System for Cardiac Arrhythmia Detection

Hardware-Algorithms Co-Design and Implementation of an Analog-to-Information Converter for Biosignals Based on Compressed Sensing

Energy-Efficient Reservoir Computing Based on Solution-Processed Electrolyte/Ferroelectric Memcapacitive Synapses for Biosignal Classification

A Low-Power ECG Processor ASIC Based on an Artificial Neural Network for Arrhythmia Detection

Reducing the Energy Cost of Inference via In-sensor Information Processing

An Implantable Neuromorphic Sensing System Featuring Near-sensor Computation and Send-on-Delta Transmission for Wireless Neural Sensing of Peripheral Nerves

Real-time ultra-low power ECG anomaly detection using an event-driven neuromorphic processor