Abstract:The growing complexity and diversity of neural networks in the fields of autonomous driving and intelligent robots have facilitated the research of many-core architectures, which can offer sufficient programming flexibility to simultaneously support multi-DNN parallel inference with different network structures and sizes compared to domain-specific architectures. However, due to the tight constraints of area and power consumption, many-core architectures typically use lightweight scalar cores without vector units and are almost unable to meet the high-performance computing needs of multi-DNN parallel inference. To solve the above problem, we design an area- and energy-efficient many-core architecture by integrating large amounts of lightweight processor cores with RV32IMA ISA. The architecture leverages the emerging SRAM-based computing-in-memory technology to implement vector instruction extensions by reusing memory cells in the data cache instead of conventional logic circuits. Thus, the data cache in each core can be reconfigured as the memory part and the computing part with the latter tightly coupled with the core pipeline, enabling parallel execution of the basic RISC-V instructions and the extended multi-cycle vector instructions. Furthermore, a corresponding execution framework is proposed to effectively map DNN models onto the many-core architecture by using intra-layer and inter-layer pipelining, which potentially supports multi-DNN parallel inference. Experimental results show that the proposed MAICC architecture obtains a 4.3 × throughput and 31.6 × energy efficiency over CPU (Intel i9-13900k). MAICC also achieves a 1.8 × energy efficiency over GPU (RTX 4090) with only 4MB on-chip memory and 28 mm2 area.

Novel many-core architecture design for real-time image processing

A Novel Reconfigurable Computing Architecture for Image Signal Processing Using Circuit-Switched NoC and Synchronous Dataflow Model.

A Manycore Vision Processor for Real-Time Smart Cameras

Video Stream Processing on a High Performance Reconfigurable Architecture

A Multi-Core Parallel Fusion Algorithm for Remote-Sensing Image

Simd Massively Parallel Processing System For Real-Time Image Processing

Novel Multicore Video Processing Architecture

A novel multi-core processor for communication applications

A homegrown many-core processor architecture for high-performance computing

A Novel Algorithm Programmable ME Co-Processor

UIC: A Unified and Scalable Chip Integrating Neuromorphic Computation and General Purpose Processor

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

MAICC : A Lightweight Many-core Architecture with In-Cache Computing for Multi-DNN Parallel Inference.

Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

Co-design of a novel CMOS highly parallel, low-power, multi-chip neural network accelerator

Heterogeneous Multi-core Systems for Video Processing

A "NEAR-THE-BEST" SYSTEM-LEVEL DESIGN METHODOLOGY OF MULTI-CORE H.264 VIDEO DECODER BASED ON THE PARALLELIZED MULTI-CORE SIMULATOR

A high speed multi-level-parallel array processor for vision chips

High Throughput Memory Data-Path Design For Multi-Core Architecture

Design Of A Dynamic Reconfigurable Coprocessor For Flexible Precision Matrix Algorithms In Media Processing And Industrial Control Applications

ActiveN: A Scalable and Flexibly-Programmable Event-Driven Neuromorphic Processor