Piyanat Kittiwisit,Steven G. Murray,Hugh Garsden,Philip Bull,Christopher Cain,Aaron R. Parsons,Jackson Sipple,Zara Abdurashidova,Tyrone Adams,James E. Aguirre,Paul Alexander,Zaki S. Ali,Rushelle Baartman,Yanga Balfour,Adam P. Beardsley,Lindsay M. Berkhout,Gianni Bernardi,Tashalee S. Billings,Judd D. Bowman,Richard F. Bradley,Jacob Burba,Steven Carey,Chris L. Carilli,Kai-Feng Chen,Carina Cheng,Samir Choudhuri,David R. DeBoer,Eloy de Lera Acedo,Matt Dexter,Joshua S. Dillon,Scott Dynes,Nico Eksteen,John Ely,Aaron Ewall-Wice,Nicolas Fagnoni,Randall Fritz,Steven R. Furlanetto,Kingsley Gale-Sides,Bharat Kumar Gehlot,Abhik Ghosh,Brian Glendenning,Adelie Gorce,Deepthi Gorthi,Bradley Greig,Jasper Grobbelaar,Ziyaad Halday,Bryna J. Hazelton,Jacqueline N. Hewitt,Jack Hickish,Tian Huang,Daniel C. Jacobs,Alec Josaitis,Austin Julius,MacCalvin Kariseb,Nicholas S. Kern,Joshua Kerrigan,Honggeun Kim,Saul A. Kohn,Matthew Kolopanis,Adam Lanman,Paul La Plante,Adrian Liu,Anita Loots,Yin-Zhe Ma,David H. E. MacMahon,Lourence Malan,Cresshim Malgas,Keith Malgas,Bradley Marero,Zachary E. Martinot,Andrei Mesinger,Mathakane Molewa,Miguel F. Morales,Tshegofalang Mosiane,Abraham R. Neben,Bojan Nikolic,Chuneeta Devi Nunhokee,Hans Nuwegeld,Robert Pascua,Nipanjana Patra,Samantha Pieterse,Yuxiang Qin,Eleanor Rath,Nima Razavi-Ghods,Daniel Riley,James Robnett,Kathryn Rosie,Mario G. Santos,Peter Sims,Saurabh Singh,Dara Storer,Hilton Swarts,Jianrong Tan,Nithyanandan Thyagarajan,Pieter van Wyngaarden,Peter K. G. Williams,Zhilei Xu,Haoxuan Zheng

Abstract:Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionisation will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability to perform high-fidelity simulations of the kinds of data that are produced by the large, many-element, radio interferometric arrays that have been purpose-built for these studies. The large scale of these arrays presents a computational challenge, as one must simulate a detailed sky and instrumental model across many hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines for arrays with hundreds of antennas. In this paper, we present a fast matrix-based method for simulating radio interferometric measurements (visibilities) at the necessary scale. We achieve this through judicious use of primary beam interpolation, fast approximations for coordinate transforms, and a vectorised outer product to expand per-antenna quantities to per-baseline visibilities, coupled with standard parallelisation techniques. We validate the results of this method, implemented in the publicly-available matvis code, against a high-precision reference simulator, and explore its computational scaling on a variety of problems.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to efficiently and with high precision simulate the data of large multi - element radio - interference arrays when observing the faint 21 - centimeter - line radiation during the Cosmic Dawn and the Epoch of Reionization. Specifically, the paper aims to develop a fast, matrix - based visibilities simulation method to address the following challenges: 1. **Faint Signals and Strong Foreground Interference**: The 21 - centimeter - line radiation is very faint (tens to hundreds of milli - Kelvin), while foreground signals such as galactic synchrotron radiation are several orders of magnitude brighter. Therefore, extremely high sensitivity and precise instrument calibration are required to detect 21 - centimeter fluctuations and prevent foreground signals from leaking into the target signal. 2. **Complex Instrument Response and Systematic Errors**: Large radio - interference arrays have complex instrument responses and systematic errors. These factors will interact with sky signals, making it difficult to fully characterize the instrument characteristics. For example, the frequency - and direction - dependent polarization main - beam patterns of antennas, the time - and frequency - variable band - pass characteristics of receivers, radio - frequency interference (RFI), environmental temperature changes, etc., will all affect the observation results. 3. **Impact of Data - Processing Tools**: Analytical tools used to mitigate data imperfections (such as dealing with RFI pollution, filtering out cable reflections, etc.) may introduce non - ideal behaviors and even suppress or filter out part of the 21 - centimeter signal. 4. **Computational - Scale Challenges**: In order to simulate the data of large - scale arrays, detailed sky and instrument model simulations must be carried out on hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines (for arrays with hundreds of antennas). This poses huge computational challenges. To solve these problems, the paper proposes a matrix - based fast - visibilities simulator **matvis**, which achieves efficient simulation in the following aspects: - **Main - Beam Interpolation**: Use pre - calculated main - beam interpolation to improve computational efficiency. - **Fast Coordinate Transformation**: Combine the precise but slower `astropy` algorithm and simple but fast trigonometric function calculations for coordinate transformation to significantly improve computational performance while maintaining high precision. - **Vectorized Outer - Product Expansion**: Expand the quantity of each antenna to the visibilities of each baseline, and use standard parallelization techniques to further accelerate the calculation. Through these methods, **matvis** can efficiently simulate the data of large - scale radio - interference arrays and has verified its computational performance and accuracy on multiple problems.

matvis: A matrix-based visibility simulator for fast forward modelling of many-element 21 cm arrays

Bayesian estimation of cross-coupling and reflection systematics in 21cm array visibility data

Direct Optimal Mapping for 21 cm Cosmology: A Demonstration with the Hydrogen Epoch of Reionization Array

The Radio Sky at Meter Wavelengths: m-Mode Analysis Imaging with the Owens Valley Long Wavelength Array

Uncovering the Effects of Array Mutual Coupling in 21-cm Experiments with the SKA-Low Radio Telescope

Mitigating calibration errors from mutual coupling with time-domain filtering of 21 cm cosmological radio observations

Detection of fast transients with radio interferometric arrays

Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling

Statistical estimation of full-sky radio maps from 21cm array visibility data using Gaussian constrained realizations

High-dimensional inference of radio interferometer beam patterns I: Parametric model of the HERA beams

Constraining the X-ray heating and reionization using 21-cm power spectra with Marginal Neural Ratio Estimation

Agora : Multi-Component Simulation for Cross-Survey Science

The Hydrogen Intensity and Real-time Analysis eXperiment: 256-Element Array Status and Overview

Spectral redundancy for calibrating interferometers and suppressing the foreground wedge in 21 cm cosmology

Understanding spectral artefacts in SKA-LOW 21-cm cosmology experiments: the impact of cable reflections

SYMBA: an End-to-end VLBI Synthetic Data Generation Pipeline

21cmfish: Fisher-matrix framework for fast parameter forecasts from the cosmic 21-cm signal

Progress in the Construction and Testing of the Tianlai Radio Interferometers

Atacama Cosmology Telescope: High-resolution component-separated maps across one third of the sky

Simulations of ionospheric refraction on radio interferometric data