Abstract:Associative memory is a cornerstone of cognitive intelligence within the human brain. The Bayesian confidence propagation neural network (BCPNN), a cortex-inspired model with high biological plausibility, has proven effective in emulating high-level cognitive functions like associative memory. However, the current approach using GPUs to simulate BCPNN-based associative memory tasks encounters challenges in latency and power efficiency as the model size scales. This work proposes a scalable multi-FPGA high performance computing (HPC) architecture designed for the associative memory system. The architecture integrates a set of hypercolumn unit (HCU) computing cores for intra-board online learning and inference, along with a spike-based synchronization scheme for inter-board communication among multiple FPGAs. Several design strategies, including population-based model mapping, packet-based spike synchronization, and cluster-based timing optimization, are presented to facilitate the multi-FPGA implementation. The architecture is implemented and validated on two Xilinx Alveo U50 FPGA cards, achieving a maximum model size of 200×10 and a peak working frequency of 220 MHz for the associative memory system. Both the memory-bounded spatial scalability and compute-bounded temporal scalability of the architecture are evaluated and optimized, achieving a maximum scale-latency ratio (SLR) of 268.82 for the two-FPGA implementation. Compared to a two-GPU counterpart, the two-FPGA approach demonstrates a maximum latency reduction of 51.72× and a power reduction exceeding 5.28× under the same network configuration. Compared with the state-of-the-art works, the two-FPGA implementation exhibits a high pattern storage capacity for the associative memory task.

A Compute Environment of ABC95 Array Computer Based on Multi-FPGA Chip

A Design of ABC95 Array Computer Multi-function Interconnection Chips

Asynchronous reconfigurable computing array design

Design of a Reconfigurable Cryptographic Engine

Study and realization of EPA communication schedule algorithm based on parallel processing

Design and FPGA Verification of a Novel Reliable Real-Time Data Transfer System

Design of Multi-serial Communication for Flight Controlling Computer Based on FPGA

An Array Computer for Low-and Intermediate-Level Image Processing

Implimentations of SIMD machine using programmable gate array

A Homogeneous Parallel Configuration Of Embedded Multi-Computer For Array Processing

Ultra-reduced microprocessor architecture in on-chip parallel computing array

An ASIC-design-based Configurable SOC Architecture for Networked Media.

Ethernet based multi-FPGA matrix multiplication parallel computing system design

A Dynamic Reconfigurable Design of Multiple Cryptographic Algorithms Based on FPGA

Multi-core System with Reconfigurable Datapath

Design of Reconfigurable On-Board Computer for Multitask

Design of Reconfigurable Computing System Based on FPGA

The Research on C40 Based Array Architecture for Image Processing

The Design and Implementation of Adaptive Reconfigurable Computing Array

Scalable Multi-FPGA HPC Architecture for Associative Memory System

4 Emerging Architectures for Reconfigurable Computing