The CuboDAQ Data Acquisition System

Ettore Zaffaroni,Guido Haefeli

2024-10-17

Abstract:CuboDAQ is a custom data acquisition system to read out SiPM-based detectors. It features electronic boards to digitize the SiPMs signal, an FPGA-based system-on-module board, the connectivity to transmit the data to a central server, and all the software necessary to operate them. The front-end is based on the TOFPET2 ASIC, produced by PETsys, connected to a custom board, featuring an Enclustra Mercury SA1 module with a Cyclone~V FPGA. Multiple boards can be operated synchronously by distributing the clock and synchronous reset signals from a central source. The system features a complete software framework to calibrate and monitor the detectors, to acquire and process data and to perform track reconstruction. The CuboDAQ system performance has been evaluated in different scenarios and can cope with sustained rates of above $4\cdot 10^6$ hits/s, with peaks of more than $7\cdot 10^6$ hits/s. This system has been employed for the readout of the SND@LHC detector at CERN, a testbeam telescope and lab setups.

Instrumentation and Detectors,High Energy Physics - Experiment

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to develop an efficient data acquisition system (DAQ) for reading detector signals based on silicon photomultipliers (SiPMs). Specifically, the CuboDAQ system is designed to read high - density SiPM arrays, which are often used in scintillating fibre (SciFi) trackers. A single DAQ board can read a total of 512 channels, but it can also be configured with a smaller number of channels and different types of SiPMs. In addition, the CuboDAQ system is designed to be scalable, allowing it to be used in laboratory settings, test beams, and medium - sized experiments.

### Main problems
1. **Readout of high - density SiPM arrays**: How to effectively read and process a large amount of data from high - density SiPM arrays to support high - precision physical experiments.
2. **Scalability of the system**: How to design a scalable system so that it can be flexibly used in different application scenarios, from laboratory settings to large - scale experiments.
3. **Data transmission and processing**: How to optimize the data transmission and processing flow to achieve high - throughput and low - latency data acquisition.
4. **Synchronization and triggering**: How to achieve precise synchronization and triggering between multiple DAQ boards to ensure data consistency and accuracy.

### Solutions
- **Hardware design**:
- **DAQ board**: Based on the Enclustra Mercury SA1 module, which contains a Cyclone V SoC FPGA and is responsible for data acquisition and transmission.
- **Front - end board**: Using the TOFPET2 ASIC, each ASIC can read 64 channels, for a total of 128 channels.
- **TTC system**: Through the TTCvi and TTCex modules in the VME chassis, providing a synchronous clock and reset signals to ensure the synchronous operation of multiple DAQ boards.

- **Software framework**:
- **Board - level server**: Runs on the ARM processor on the DAQ board and is responsible for communicating with the FPGA, reading data and transmitting it to the central server.
- **DAQ server**: Receives data from the DAQ board, performs event construction and processing, and writes the data to disk.
- **Control software**: A Python - based control module for system configuration, calibration, and monitoring.

- **Performance evaluation**:
- **Data transfer rate**: A single DAQ board can handle a hit rate of up to 1.3 MHz, while the DAQ server can handle an average data rate of more than 4 × 10^6 hits per second, with an instantaneous rate of up to 7 × 10^6 hits per second.
- **Synchronization and triggering**: Precise synchronization and triggering are achieved through the TTC system, ensuring the consistency of multi - board operations.

### Application scenarios
- **SND@LHC experiment**: The CuboDAQ system is used in the SND@LHC experiment, which is a neutrino detector at the Large Hadron Collider (LHC) and has been in operation since 2022.
- **Test beam**: Used in test - beam experiments to verify the performance and reliability of the system.
- **Laboratory settings**: Used in multiple projects at EPFL, including test - beam telescopes, the development of a new generation of SiPMs, and the development of electromagnetic calorimeters.

Through the above design and implementation, the CuboDAQ system has successfully solved multiple key problems such as high - density SiPM array readout, system scalability, data transmission and processing, and synchronization and triggering, providing a reliable data acquisition solution for high - energy physics experiments.