Abstract:We present an overview of the ‘ICE’ hardware and software framework that implements large arrays of interconnected field-programmable gate array (FPGA)-based data acquisition, signal processing and networking nodes economically. The system was conceived for application to radio, millimeter and sub-millimeter telescope readout systems that have requirements beyond typical off-the-shelf processing systems, such as careful control of interference signals produced by the digital electronics, and clocking of all elements in the system from a single precise observatory-derived oscillator. A new generation of telescopes operating at these frequency bands and designed with a vastly increased emphasis on digital signal processing to support their detector multiplexing technology or high-bandwidth correlators — data rates exceeding a terabyte per second — are becoming common. The ICE system is built around a custom FPGA motherboard that makes use of an Xilinx Kintex-7 FPGA and ARM-based co-processor. The system is specialized for specific applications through software, firmware and custom mezzanine daughter boards that interface to the FPGA through the industry-standard FPGA mezzanine card (FMC) specifications. For high density applications, the motherboards are packaged in 16-slot crates with ICE backplanes that implement a low-cost passive full-mesh network between the motherboards in a crate, allow high bandwidth interconnection between crates and enable data offload to a computer cluster. A Python-based control software library automatically detects and operates the hardware in the array. Examples of specific telescope applications of the ICE framework are presented, namely the frequency-multiplexed bolometer readout systems used for the South Pole Telescope (SPT) and Simons Array and the digitizer, F-engine, and networking engine for the Canadian Hydrogen Intensity Mapping Experiment (CHIME) and Hydrogen Intensity and Real-time Analysis eXperiment (HIRAX) radio interferometers.

A GPU Spatial Processing System for CHIME

HyGrid: A CPU-GPU Hybrid Convolution-Based Gridding Algorithm in Radio Astronomy.

The Implementation of the Three-Dimensional Unified Gas-Kinetic Wave-Particle Method on Multiple Graphics Processing Units

ICE-based Custom Full-Mesh Network for the CHIME High Bandwidth Radio Astronomy Correlator

Efficient channelization on a Graphics Processing Unit

Special Purpose Computer for Digital Holographic Particle Tracking Velocimetry

SEECHIP: A Scalable and Energy-Efficient Chiplet-based GPU Architecture Using Photonic Links.

GPU-Based Parallel Implementation of VLBI Correlator for Deep Space Exploration System

Accelerating Channel Estimation and Demodulation of Uplink OFDM symbols for Large Scale Antenna Systems using GPU

GPU-assisted High-Resolution, Real-Time 3-D Shape Measurement.

Accelerating Communication for Parallel Programming Models on GPU Systems

GPU Acceleration of Real-Time Control Loops

Towards a GPU accelerated spatial computing framework

GAMER: a GPU-Accelerated Adaptive Mesh Refinement Code for Astrophysics

Phaseless Auxiliary-Field Quantum Monte Carlo on Graphical Processing Units

A Framework for Lattice QCD Calculations on GPUs

A GPU Poisson-Fermi Solver for Ion Channel Simulations

ICE: A Scalable, Low-Cost FPGA-Based Telescope Signal Processing and Networking System

MIMO Radar Hardware Acceleration with Enhanced Resolution

High-Performance Ptychographic Reconstruction with Federated Facilities

Parallelizing the QUDA Library for Multi-GPU Calculations in Lattice Quantum Chromodynamics