Abstract:The rapid advancement of artificial intelligence (AI) technology, combined with the widespread proliferation of Internet of Things (IoT) devices, has significantly expanded the scope of AI applications, from data centers to edge devices. Running AI applications on edge devices requires a careful balance between data processing performance and energy efficiency. This challenge becomes even more critical when the computational load of applications dynamically changes over time, making it difficult to maintain optimal performance and energy efficiency simultaneously. To address these challenges, we propose a novel processing-in-memory (PIM) technology that dynamically optimizes performance and power consumption in response to real-time workload variations in AI applications. Our proposed solution consists of a new PIM architecture and an operational algorithm designed to maximize its effectiveness. The PIM architecture follows a well-established structure known for effectively handling data-centric tasks in AI applications. However, unlike conventional designs, it features a heterogeneous configuration of high-performance PIM (HP-PIM) modules and low-power PIM (LP-PIM) modules. This enables the system to dynamically adjust data processing based on varying computational load, optimizing energy efficiency according to the application's workload demands. In addition, we present a data placement optimization algorithm to fully leverage the potential of the heterogeneous PIM architecture. This algorithm predicts changes in application workloads and optimally allocates data to the HP-PIM and LP-PIM modules, improving energy efficiency. To validate and evaluate the proposed technology, we implemented the PIM architecture and developed an embedded processor that integrates this architecture. We performed FPGA prototyping of the processor, and functional verification was successfully completed. Experimental results from running applications with varying workload demands on the prototype PIM processor demonstrate that the proposed technology achieves up to 29.54% energy savings.

Edge Artificial Intelligence for Electrical Anomaly Detection Based on Process-In-Memory Chip

Novel Feature Set Based on Bayesian Approach for Circuit Breaker Fault Detection

An Electromagnetic Perspective of Artificial Intelligence Neuromorphic Chips

Artificial Intelligence-Assisted Edge Computing for Wide Area Monitoring

Anomaly detection based on lightweight deep learning algorithms

Edge AI without Compromise: Efficient, Versatile and Accurate Neurocomputing in Resistive Random-Access Memory

Intelligent patrol terminal of transmission line based on AI chip accelerated calculation

Dynamic Performance and Power Optimization with Heterogeneous Processing-in-Memory for AI Applications on Edge Devices

Circuit and System Technologies for Energy-Efficient Edge Robotics

Ultra-Low Power Silicon Neuron Circuit for Extreme-Edge Neuromorphic Intelligence

A novel fault diagnosis method of smart grids based on memory spiking neural P systems considering measurement tampering attacks

Precise and low-power closed-loop neuromodulation through algorithm-integrated circuit co-design

Ultra-Low-Power FDSOI Neural Circuits for Extreme-Edge Neuromorphic Intelligence

ANP-I: A 28-Nm 1.5-Pj/sop Asynchronous Spiking Neural Network Processor Enabling Sub-0.1-μJ/Sample On-Chip Learning for Edge-AI Applications

Design of Switched-Current Based Low-Power PIM Vision System for IoT Applications

ANP-I: A 28-nm 1.5-pJ/SOP Asynchronous Spiking Neural Network Processor Enabling Sub-0.1-$\mu $J/Sample On-Chip Learning for Edge-AI Applications

Low-Power and Low-Cost AI Processor with Distributed-Aggregated Classification Architecture for Wearable Epilepsy Seizure Detection

Tempo-CIM: A RRAM Compute-in-Memory Neuromorphic Accelerator with Area-Efficient LIF Neuron and Split-Train-Merged-Inference Algorithm for Edge AI Applications.

Characterization of Single-Event Effects in a Microcontroller with an Artificial Neural Network Accelerator

12.1 A 148nw General-Purpose Event-Driven Intelligent Wake-Up Chip for AIoT Devices Using Asynchronous Spike-Based Feature Extractor and Convolutional Neural Network

NS-Engine: Near-Sensor Neural Network Engine with SRAM-Based Compute-in-Memory Macro