Abstract:We present a tiny MultiLayer Perceptron (MLP) accelerator named Single Perceptron Linear Vector Processor (SPLVP) that aims at extending the capabilities of limited resources MCUs, enabling inference time speedup and main CPU off-load. It is based on a single perceptron hardware unit, enhanced with an additional accumulation input and scaling features, that is sequentially scheduled to cover all the nodes of the network. The accelerator supports both linear and Rectified Linear Unit (ReLU) activation and its firmware can be generated from 8-bit tflite quantized models. We also present a complete design toolchain that encompasses supervised learning, compilation, assembly, simulation, and device programming. The hardware support for extra accumulation input and scaling, together with the processor memory partitioning, are the key features that enable significant speedups. By solving a toy recognition problem based on image data captured from an infra-red camera, measurements show that the execution speed of SPLVP at 80MHz outperforms an ARM Cortex-M4 STM32L476 microcontroller by a factor of 9.2 when the same ANN is translated to MCU code using the STM CubeMX-Ai converter at the same clock frequency. SPLVP is synthesized on a low-cost and gate-count Cyclone 10 LP FPGA resulting in an 18% logic and 77% memory occupation. The SPLVP assembly code can be directly converted into a VHDL description that directly hardcodes the ANN. The execution speed of an ANN model for Iris classification, fully synthesized, improves by a factor of 209 compared to firmware execution on the MCU. To verify the operation of SPLVP and its design framework, we have designed various tiny Machine Learning (ML) classifiers, for which we briefly discuss the obtained performance and the preprocessing techniques used. Across all these classifiers, the obtained speedup compared to the STM32 is 8.3–14.9 .

Sequential Printed MLP Circuits for Super TinyML Multi-Sensory Applications

Bespoke Approximation of Multiplication-Accumulation and Activation Targeting Printed Multilayer Perceptrons

Hardware-Aware Automated Neural Minimization for Printed Multilayer Perceptrons

Co-Design of Approximate Multilayer Perceptron for Ultra-Resource Constrained Printed Circuits

Model-to-Circuit Cross-Approximation For Printed Machine Learning Classifiers

Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Review

Embedding Hardware Approximations in Discrete Genetic-based Training for Printed MLPs

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

An Ultra-low Power TinyML System for Real-time Visual Processing at Edge

An 8-bit Single Perceptron Processing Unit for Tiny Machine Learning Applications

Tiny Machine Learning: Progress and Futures

Toward Attention-based TinyML: A Heterogeneous Accelerated Architecture and Automated Deployment Flow

Introduction to the Special Issue on tinyML

TinyML: Tools, Applications, Challenges, and Future Research Directions

Complementary Memtransistor-Based Multilayer Neural Networks for Online Supervised Learning Through (Anti-)Spike-Timing-Dependent Plasticity

Design of a Novel Neural Network Compression Method for Tiny Machine Learning

Design-Technology Co-Optimization for NVM-based Neuromorphic Processing Elements

Unlocking the potential of two-point cells for energy-efficient and resilient training of deep nets

A Review on the emerging technology of TinyML

PIXEL: Photonic Neural Network Accelerator

TinyM$^2$Net-V3: Memory-Aware Compressed Multimodal Deep Neural Networks for Sustainable Edge Deployment