Abstract:We present a tiny MultiLayer Perceptron (MLP) accelerator named Single Perceptron Linear Vector Processor (SPLVP) that aims at extending the capabilities of limited resources MCUs, enabling inference time speedup and main CPU off-load. It is based on a single perceptron hardware unit, enhanced with an additional accumulation input and scaling features, that is sequentially scheduled to cover all the nodes of the network. The accelerator supports both linear and Rectified Linear Unit (ReLU) activation and its firmware can be generated from 8-bit tflite quantized models. We also present a complete design toolchain that encompasses supervised learning, compilation, assembly, simulation, and device programming. The hardware support for extra accumulation input and scaling, together with the processor memory partitioning, are the key features that enable significant speedups. By solving a toy recognition problem based on image data captured from an infra-red camera, measurements show that the execution speed of SPLVP at 80MHz outperforms an ARM Cortex-M4 STM32L476 microcontroller by a factor of 9.2 when the same ANN is translated to MCU code using the STM CubeMX-Ai converter at the same clock frequency. SPLVP is synthesized on a low-cost and gate-count Cyclone 10 LP FPGA resulting in an 18% logic and 77% memory occupation. The SPLVP assembly code can be directly converted into a VHDL description that directly hardcodes the ANN. The execution speed of an ANN model for Iris classification, fully synthesized, improves by a factor of 209 compared to firmware execution on the MCU. To verify the operation of SPLVP and its design framework, we have designed various tiny Machine Learning (ML) classifiers, for which we briefly discuss the obtained performance and the preprocessing techniques used. Across all these classifiers, the obtained speedup compared to the STM32 is 8.3–14.9 .

Multiplierless In-filter Computing for tinyML Platforms

Multiplierless MP-Kernel Machine for Energy-Efficient Edge Devices

Optimally Approximated and Unbiased Floating-Point Multiplier with Runtime Configurability

In-filter Computing For Designing Ultra-light Acoustic Pattern Recognizers

A Reconfigurable Multiplier for Signed Multiplications with Asymmetric Bit-Widths.

PAM: A Piecewise-Linearly-Approximated Floating-Point Multiplier with Unbiasedness and Configurability

A Novel Multiplierless Hardware Implementation Method for Adaptive Filter Coefficients.

ML-MCU: A Framework to Train ML Classifiers on MCU-based IoT Edge Devices

TinyM$^2$Net: A Flexible System Algorithm Co-designed Multimodal Learning Framework for Tiny Devices

An 8-bit Single Perceptron Processing Unit for Tiny Machine Learning Applications

A Multiplier Structure Based on A Novel Real-Time Csd Recoding

A Deep Learning Inference Scheme Based on Pipelined Matrix Multiplication Acceleration Design and Non-uniform Quantization

CFU Playground: Full-Stack Open-Source Framework for Tiny Machine Learning (tinyML) Acceleration on FPGAs

Towards Vision Mixture of Experts for Wildlife Monitoring on the Edge

No Multiplication? No Floating Point? No Problem! Training Networks for Efficient Inference

Tiny Classifier Circuits: Evolving Accelerators for Tabular Data

TinyChirp: Bird Song Recognition Using TinyML Models on Low-power Wireless Acoustic Sensors

TinyM$^2$Net-V3: Memory-Aware Compressed Multimodal Deep Neural Networks for Sustainable Edge Deployment

Accelerating TinyML Inference on Microcontrollers through Approximate Kernels

SMaLL: A Software Framework for portable Machine Learning Libraries

Decoupled Access-Execute enabled DVFS for tinyML deployments on STM32 microcontrollers