Abstract:Smart sensors are an emerging technology that allows combining the data acquisition with the elaboration directly on the Edge device, very close to the sensors. To push this concept to the extreme, technology companies are proposing a new generation of sensors allowing to move the intelligence from the edge host device, typically a microcontroller, directly to the ultra-low-power sensor itself, in order to further reduce the miniaturization, cost and energy efficiency. This paper evaluates the capabilities of a novel and promising solution from STMicroelectronics. The presence of a floating point unit and an accelerator for binary neural networks provide capabilities for in-sensor feature extraction and machine learning. We propose a comparison of full-precision and binary neural networks for activity recognition with accelerometer data generated by the sensor itself. Experimental results have demonstrated that the sensor can achieve an inference performance of 10.7 cycles/MAC, comparable to a Cortex-M4-based microcontroller, with full-precision networks, and up to 1.5 cycles/MAC with large binary models for low latency inference, with an average energy consumption of only 90 $\mu$J/inference with the core running at 5 MHz.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: how to implement intelligent computing on the ultra - low - power - consumption sensor itself, so as to further reduce the volume and cost of the device and improve energy efficiency. Specifically, the paper explores integrating machine - learning capabilities directly into the sensor instead of relying on traditional microcontrollers or cloud - based processing. ### Problem Background With the development of the Internet of Things (IoT), more and more intelligent sensors are deployed in the physical world for automatic information extraction. However, transmitting all data to the cloud for processing has many problems, including high energy consumption, latency, reliability, and privacy issues. Therefore, integrating intelligent computing directly into the sensor has become a new trend. ### Research Objectives This paper evaluates the capabilities of a new type of intelligent sensor designed by STMicroelectronics, which has an intelligent sensor processing unit (ISPU) built - in, with a floating - point arithmetic unit (FPU) and a binary neural network accelerator. The main research objectives are: 1. **Evaluate the performance of the new - type sensor**: Evaluate the performance of the sensor under different loads by comparing the full - precision and binary neural networks. 2. **Optimize energy efficiency**: Verify the energy efficiency of the sensor when performing machine - learning tasks, especially the energy - efficiency improvement when using the binary neural network. 3. **Practical application scenarios**: Verify the application potential of the sensor in the real world through activity - recognition tasks. ### Main Contributions - Design and implement benchmark neural networks (including full - precision and binary networks) to evaluate the performance of the ISM330AILP sensor. - Compare the performance of different neural network architectures in the feature - extraction and inference processes. - Provide detailed experimental results, showing the MAC operation cycles and energy - consumption situations of the sensor under different conditions. ### Experimental Results The experimental results show that the performance of the sensor when executing the full - precision network is comparable to that of the Cortex - M4 - based microcontroller, with an average energy consumption of only 90µJ per inference. For large - scale binary models, using a dedicated BNN accelerator can achieve a speed - up of about 7 times. ### Conclusions The paper shows that the ISM330AILP sensor and its built - in ISPU are suitable for running small - scale full - precision neural networks, and can run large - scale binary neural networks efficiently when the memory allows, significantly improving energy efficiency. This provides an important reference for future intelligent - sensor design. --- In summary, this paper aims to explore how to implement efficient intelligent computing in ultra - low - power - consumption sensors to meet the increasing data - processing demands of Internet - of - Things devices.

Machine Learning In-Sensors: Computation-enabled Intelligent Sensors For Next Generation of IoT

Neuromorphic Near-Sensor Computing: From Event-Based Sensing to Edge Learning

Intelligence at the IoT Edge: Activity Recognition with Low-Power Microcontrollers and Convolutional Neural Networks

Edge Machine Learning for AI-Enabled IoT Devices: A Review

Exploring Artificial Neural Networks Efficiency in Tiny Wearable Devices for Human Activity Recognition

Advances in Machine‐Learning Enhanced Nanosensors: From Cloud Artificial Intelligence Toward Future Edge Computing at Chip Level

Machine Learning at the Network Edge: A Survey

Machine Learning for Microcontroller-Class Hardware: A Review

Energy-efficient and Privacy-aware Social Distance Monitoring with Low-resolution Infrared Sensors and Adaptive Inference

Machine Learning on Mainstream Microcontrollers

Artificial Intelligence-Based Sensors for Next Generation IoT Applications: A Review

Spiking Neural Network-Based Near-Sensor Computing for Damage Detection in Structural Health Monitoring

An adaptive cognitive sensor node for ECG monitoring in the Internet of Medical Things

Reducing the Energy Cost of Inference via In-sensor Information Processing

FANN-on-MCU: An Open-Source Toolkit for Energy-Efficient Neural Network Inference at the Edge of the Internet of Things

SensorNet: A Scalable and Low-Power Deep Convolutional Neural Network for Multimodal Data Classification

Tiny Machine Learning for High Accuracy Product Quality Inspection

A Future Perspective on In-Sensor Computing

In-sensor nonlinear convolutional processing based on hybrid MTJ/CMOS arrays

Ultra-low-power Physical Activity Classifier for Wearables: From Generic MCUs to ASICs