Abstract:Associative memory is a cornerstone of cognitive intelligence within the human brain. The Bayesian confidence propagation neural network (BCPNN), a cortex-inspired model with high biological plausibility, has proven effective in emulating high-level cognitive functions like associative memory. However, the current approach using GPUs to simulate BCPNN-based associative memory tasks encounters challenges in latency and power efficiency as the model size scales. This work proposes a scalable multi-FPGA high performance computing (HPC) architecture designed for the associative memory system. The architecture integrates a set of hypercolumn unit (HCU) computing cores for intra-board online learning and inference, along with a spike-based synchronization scheme for inter-board communication among multiple FPGAs. Several design strategies, including population-based model mapping, packet-based spike synchronization, and cluster-based timing optimization, are presented to facilitate the multi-FPGA implementation. The architecture is implemented and validated on two Xilinx Alveo U50 FPGA cards, achieving a maximum model size of 200×10 and a peak working frequency of 220 MHz for the associative memory system. Both the memory-bounded spatial scalability and compute-bounded temporal scalability of the architecture are evaluated and optimized, achieving a maximum scale-latency ratio (SLR) of 268.82 for the two-FPGA implementation. Compared to a two-GPU counterpart, the two-FPGA approach demonstrates a maximum latency reduction of 51.72× and a power reduction exceeding 5.28× under the same network configuration. Compared with the state-of-the-art works, the two-FPGA implementation exhibits a high pattern storage capacity for the associative memory task.

A Shared Memory Module for Asynchronous Arrays of Processors

Design of Dual-Shared Dram Controller Based on Switch

Concurrent Processing Memory

An 800mhz 320mw 16-Core Processor with Message-Passing and Shared-Memory Inter-Core Communication Mechanisms

AsAP: an Asynchronous Array of Simple Processors

Memory System Design and Implementation for a Multiprocessor

Combinatorics and Geometry for the Many-ported, Distributed and Shared Memory Architecture

An Asynchronous Array of Simple Processors for Dsp Applications

A 16-Core Processor With Shared-Memory and Message-Passing Communications

A 167-Processor 65 Nm Computational Platform with Per-Processor Dynamic Supply Voltage and Dynamic Clock Frequency Scaling

Low-latency SDRAM Controller for Shared Memory in MPSoC

Advanced Extensible Crossbar Protocol for Connecting Multi-Cores and Shared-Memory on-Chip

MeMPA: A Memory Mapped M-SIMD Co-Processor to Cope with the Memory Wall Issue

A Digital-Optical System-on-package Module Architecture for High Performance Multiprocessors

A Low-Area Multi-Link Interconnect Architecture for GALS Chip Multiprocessors

Hardware Support for Message-Passing in Chip Multi-Processors.

A 167-Processor Computational Platform in 65 Nm CMOS

Scalable Multi-FPGA HPC Architecture for Associative Memory System

Reconfigurable Mpb Combined with Cache Coherence Protocol in Many-Core

High Performance and Energy Efficient Many-core DSP Systems: An Asynchronous Array of Simple Processors

A Scalable Distributed Memory Architecture For Network On Chip