Abstract:Tiny machine learning (TinyML) envisions executing a deep neural network (DNN)-based inference on an edge device for improving battery life, latency, security, and privacy. Toward this vision, recent microcontroller units (MCUs) integrate in-memory computing (IMC) hardware to leverage its high energy efficiency and throughput in vector–matrix multiplication (VMM). However, those existing works require large IMC hardware, severely increasing the area overhead. In addition, most existing works use analog–mixed-signal (AMS) IMC hardware, exhibiting limited robustness over process, voltage, and temperature (PVT) variations. Finally, none can support a practical software development framework such as TensorFlow Lite for Microcontrollers (TFLite-micro). Due to these limitations, those MCUs did not present the performance for the standard benchmark MLPerf-Tiny, which makes it difficult to evaluate them against the state-of-the-art neural (not necessarily IMC-based) MCUs. In this article, we design a new IMC-based MCU, titled iMCU, for TinyML to address those challenges. In the design process, we: 1) define the optimal set of acceleration targets and 2) devise an area-efficient computation flow that requires the least amount of IMC hardware yet still provides a significant acceleration. In addition, we develop: 1) state-of-the-art digital IMC macros and 2) create the accelerator based on the macros, which can support the proposed computation flow in a fully pipelined manner. Combining those innovations, we prototyped the iMCU in a 28-nm CMOS. The measurement results show that the iMCU significantly outperforms the prior IMC-based MCUs in compute density, energy efficiency, and SRAM density (total SRAM size/total SRAM area). It also achieves a compact footprint of 2.73 mm $^2$ .

Embedded Micro-Controller Unit System for Mixed-Signal Processor

Design of a Media-Enhanced and Reconfigurable RISC ,Microprocessor

The Application for S3C4510B in Remote Digital Video Monitor System

MediaSoC: a system-on-chip architecture for multimedia application

Design Of Portable Infrared Business Card Exchange System On Chip

A 1-Mb Programming Configurable ReRAM Fully Integrating into a 32-Bit Microcontroller Unit.

Design and Implementation of an On-Chip Low-Power and High-Flexibility System for Data Acquisition and Processing of an Inertial Measurement Unit.

Hardware-Assisted Security Monitoring Unit for Real-Time Ensuring Secure Instruction Execution and Data Processing in Embedded Systems

Design of application specific embedded memory management unit

Design and Implementation of 16-bit RISC MCU for Medical Electronics Applications

iMCU: A 28-nm Digital In-Memory Computing-Based Microcontroller Unit for TinyML

Asynchronous Pipeline Micro-Control-Unit (mcu) Chip Design

Transport of Uc/os- Ⅱ on S3C44B0X Microprocessor

Implementation of an Embedded Dual-Core Processor for Portable Medical Electronics Applications

Merging SoC and LOC Together

C 2 IM: A Compact Computing-In-Memory Unit of 10 Transistors with Standard 6T SRAM

Memory management unit design for embedded system

Design and Implementation of Memory Management Unit on MIPS

Design of Write Merging and Read Prefetching Buffer in DRAM Controller for Embedded Processor.

A 5.6-89.9TOPS/W Heterogeneous Computing-in-Memory SoC with High-Utilization Producer-Consumer Architecture and High-Frequency Read-Free CIM Macro.

System-on-chip implementation of embedded real-time simulator for modular multilevel converters