Abstract:Ultra-low-resolution Infrared (IR) array sensors offer a low-cost, energy-efficient, and privacy-preserving solution for people counting, with applications such as occupancy monitoring and visitor flow analysis in private and public spaces. Previous work has shown that Deep Learning (DL) can yield superior performance on this task. However, the literature was missing an extensive comparative analysis of various efficient DL architectures for IR array-based people counting, that considers not only their accuracy, but also the cost of deploying them on memory-and energy-constrained Internet of Things (IoT) edge nodes. Such analysis is key for system designers, since it helps them select the most appropriate DL model given the constraints of their target hardware. In this work, we address this need by comparing 6 different DL architectures on a novel dataset composed of IR images collected from a commercial 8x8 array, which we made openly available. With a wide architectural exploration of each model type, we obtain a rich set of Pareto-optimal solutions, spanning cross-validated balanced accuracy scores in the 55.70-82.70% range. When deployed on a commercial Microcontroller (MCU) by STMicroelectronics, the STM32L4A6ZG, these models occupy 0.41-9.28kB of memory, and require 1.10-7.74ms per inference, while consuming 17.18-120.43 of energy. Our models are significantly more accurate than a previous deterministic method (up to +39.9%), while being up to 3.53x faster and more energy efficient. So, our work serves also as a demonstration that DL can not only achieve higher accuracy, but also higher efficiency compared to classic algorithms for this type of task. Further, our models accuracy is comparable to state-of-the-art DL solutions on similar resolution sensors, despite a much lower complexity. All our models enable continuous, real-time inference on a MCU-based IoT node, with years of autonomous operation without battery recharging.

A Low Power Infrared Sensor for Direction, Speed, Distance Finding for Contextual Intelligence

Non-Imaging Digital CMOS-SOI-MEMS Uncooled Passive Infra-Red Sensing Systems

Smart CMOS mid-infrared sensor array

Viability of Low-Cost Infrared Sensors for Short Range Tracking

Multiframe-integrated, In-Sensor Computing Using Persistent Photoconductivity

A Low-Power Optoelectronic Receiver IC for Short-Range LiDAR Sensors in 180 nm CMOS

A Low-Power Low-Noise 160×120 17µm Pixel Pitch TEC-less Uncooled Infrared Image Sensor

Energy-efficient and Privacy-aware Social Distance Monitoring with Low-resolution Infrared Sensors and Adaptive Inference

An Ultra-Low-Power Temperature Sensor with an Accuracy of +0.6/-1 °C From−30 °C to 90 °C

An Ultra-Low-power CMOS Temperature Sensor for RFID Applications

Monitoring Indoor People Presence in Buildings Using Low-Cost Infrared Sensor Array in Doorways

Performance Improvement of Integrated MEMS Temperature, Humidity, and Air Velocity Sensors for Application in Smart Buildings

Exploiting the PIR Sensor Analog Behavior as Thermoreceptor: Movement Direction Classification Based on Spiking Neurons

A Low-Power, Low-Cost Infra-Red Emitter in CMOS Technology

Human movement counter using pyroelectric infrared detectors

Towards Robust Velocity and Position Estimation of Opponents for Autonomous Racing Using Low-Power Radar

The Implementation of Low Power SoC Chip and Solution for Infrared Temperature Measurement

Efficient Deep Learning Models for Privacy-preserving People Counting on Low-resolution Infrared Arrays

Low-Power Radio-Optical Beacons for In-View Recognition.

Reduced CPU Workload for Human Pose Detection with the Aid of a Low-Resolution Infrared Array Sensor on Embedded Systems