Abstract:Associative memory is a cornerstone of cognitive intelligence within the human brain. The Bayesian confidence propagation neural network (BCPNN), a cortex-inspired model with high biological plausibility, has proven effective in emulating high-level cognitive functions like associative memory. However, the current approach using GPUs to simulate BCPNN-based associative memory tasks encounters challenges in latency and power efficiency as the model size scales. This work proposes a scalable multi-FPGA high performance computing (HPC) architecture designed for the associative memory system. The architecture integrates a set of hypercolumn unit (HCU) computing cores for intra-board online learning and inference, along with a spike-based synchronization scheme for inter-board communication among multiple FPGAs. Several design strategies, including population-based model mapping, packet-based spike synchronization, and cluster-based timing optimization, are presented to facilitate the multi-FPGA implementation. The architecture is implemented and validated on two Xilinx Alveo U50 FPGA cards, achieving a maximum model size of 200×10 and a peak working frequency of 220 MHz for the associative memory system. Both the memory-bounded spatial scalability and compute-bounded temporal scalability of the architecture are evaluated and optimized, achieving a maximum scale-latency ratio (SLR) of 268.82 for the two-FPGA implementation. Compared to a two-GPU counterpart, the two-FPGA approach demonstrates a maximum latency reduction of 51.72× and a power reduction exceeding 5.28× under the same network configuration. Compared with the state-of-the-art works, the two-FPGA implementation exhibits a high pattern storage capacity for the associative memory task.

Efficient Distributed Memory Management in a Multi-Core H.264 Decoder on FPGA

Distributed Memory Service Modeling in Multi-Processor Design

Evaluation and Design Trade-Offs Between Symmetric Shared-Memory and Distributed Shared-Memory

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

FeFET-Based In-Memory Hyperdimensional Encoding Design

H.264 decoder on a 16-core processor with shared-memory and massage-passing communications

An efficient methodology for transaction-level design of multi-core h.264 video decoder

Design of H.264/AVC Video Coder Based on Mixed Architecture

Scalable Multi-FPGA HPC Architecture for Associative Memory System

A "NEAR-THE-BEST" SYSTEM-LEVEL DESIGN METHODOLOGY OF MULTI-CORE H.264 VIDEO DECODER BASED ON THE PARALLELIZED MULTI-CORE SIMULATOR

Architecture Design for H.264/AVC Integer Motion Estimation with Minimum Memory Bandwidth

Heterogeneous multi-core SOC architecture for MPEG decoding

High Throughput Memory Data-Path Design For Multi-Core Architecture

Memory Efficient Block-Serial Architecture for Programmable, Multi-Rate Multi-Length LDPC Decoder

A Parallel Memory Architecture for Video Coding

A High-Performance Memory Storage Architecture for MP@HL MPEG2 Decoder Chip

System design of full HD MVC decoding on mesh-based multicore NoCs

A Power-Efficient Prediction Hardware Architecture for H.264 Decoding

A High-Performance Memory Storage Architecture for MPEG2 Decoder

FPGA-Based HPC for Associative Memory System

Optimizing a Parallel Video Encoder with Message Passing and a Shared Memory Architecture