Abstract:Ultra-low-resolution Infrared (IR) array sensors offer a low-cost, energy-efficient, and privacy-preserving solution for people counting, with applications such as occupancy monitoring and visitor flow analysis in private and public spaces. Previous work has shown that Deep Learning (DL) can yield superior performance on this task. However, the literature was missing an extensive comparative analysis of various efficient DL architectures for IR array-based people counting, that considers not only their accuracy, but also the cost of deploying them on memory-and energy-constrained Internet of Things (IoT) edge nodes. Such analysis is key for system designers, since it helps them select the most appropriate DL model given the constraints of their target hardware. In this work, we address this need by comparing 6 different DL architectures on a novel dataset composed of IR images collected from a commercial 8x8 array, which we made openly available. With a wide architectural exploration of each model type, we obtain a rich set of Pareto-optimal solutions, spanning cross-validated balanced accuracy scores in the 55.70-82.70% range. When deployed on a commercial Microcontroller (MCU) by STMicroelectronics, the STM32L4A6ZG, these models occupy 0.41-9.28kB of memory, and require 1.10-7.74ms per inference, while consuming 17.18-120.43 of energy. Our models are significantly more accurate than a previous deterministic method (up to +39.9%), while being up to 3.53x faster and more energy efficient. So, our work serves also as a demonstration that DL can not only achieve higher accuracy, but also higher efficiency compared to classic algorithms for this type of task. Further, our models accuracy is comparable to state-of-the-art DL solutions on similar resolution sensors, despite a much lower complexity. All our models enable continuous, real-time inference on a MCU-based IoT node, with years of autonomous operation without battery recharging.

Urinary d-glucaric acid excretion and serum gamma-glutamyl transpeptidase activity in alcoholism.

Characterization of Real-Time Object Detection Workloads on Vehicular Edge

AI-assisted Action in Edge Computing System: A Joint Latency and Accuracy Oriented Approach

Multiframe-integrated, In-Sensor Computing Using Persistent Photoconductivity

Energy-efficient and Privacy-aware Social Distance Monitoring with Low-resolution Infrared Sensors and Adaptive Inference

Survey of undeclared egg allergen levels in the most frequently recalled food types (including products bearing precautionary labelling)

A low cost architecture for high performance face detection

Efficient Deep Learning Models for Privacy-preserving People Counting on Low-resolution Infrared Arrays

Data Processing Unit for Energy Saving in Computer Vision: Weapon Detection Use Case

Real-Time Human Pose Detection and Recognition Using MediaPipe

CNN Inference acceleration using low-power devices for human monitoring and security scenarios

A Wearable Multi-Modal Edge-Computing System for Real-Time Kitchen Activity Recognition

Design of embedded real-time human detection system based on Zynq platform

Towards Real-Time Object Detection on Embedded Systems.

Wise Information Technology of Med: Human Pose Recognition in Elderly Care

SmartAct: Energy Efficient and Real-Time Hand-to-Mouth Gesture Detection Using Wearable RGB-T

Adaptive Human Detection Approach Using FPGA-based Parallel Architecture in Reconfigurable Hardware.

Reducing the Energy Cost of Inference via In-sensor Information Processing

An Efficient Face Detector on a CPU Using Dual-Camera Sensors for Intelligent Surveillance Systems

Real-Time Detection of Cook Assistant Overalls Based on Embedded Reasoning

A low-power end-to-end hybrid neuromorphic framework for surveillance applications