Abstract:We investigate the issue in determining the significance of candidate transient gravitational-wave events in a ground-based interferometer network. Given the presence of non-Gaussian noise artefacts in real data, the noise background must be estimated empirically from the data itself. However, the data also potentially contains signals, thus the background estimate may be overstated due to contributions from signals. It has been proposed to mitigate possible bias by removing single-detector data samples that pass a multi-detector consistency test from the background estimates. We conduct a high-statistics Mock Data Challenge to evaluate the effects of removing such samples, modelling a range of scenarios with plausible detector noise distributions and with a range of plausible foreground astrophysical signal rates. We consider the two different modes: one in which coincident samples are removed, and one in which all samples are retained and used. Three algorithms were operated in both modes, show good consistency with each other; however, discrepancies arise between the results obtained under the "coincidence removal" and "all samples" modes, for false alarm probabilities below a certain value. In most scenarios the median of the false alarm probability (FAP) estimator under the "all samples" mode is consistent with the exact FAP. On the other hand the "coincidence removal" mode is found to be unbiased for the mean of the estimated FAP. While the numerical values at which discrepancies become apparent are specific to the details of our experiment, we believe that the qualitative differences in the behaviour of the median and mean of the FAP estimator have more general validity. On the basis of our study we suggest that the FAP of candidates for the first detection of gravitational waves should be estimated without removing single-detector samples that form coincidences.

Beyond single-threshold searches: the Event Stacking Test

Empirically estimating the distribution of the loudest candidate from a gravitational-wave search

A Comprehensive Analysis of the Gravitational Wave Events with the Stacked Hilbert–Huang Transform: From Compact Binary Coalescence to Supernova

Targeted Sub-threshold Search for Strongly-lensed Gravitational-wave Events

Calibrating signal-to-noise ratio detection thresholds using gravitational-wave catalogs

Spectrogram correlated stacking: A novel time-frequency domain analysis of the stochastic gravitational wave background

QoQ: a Q-transform based test for Gravitational Wave transient events

Systematic errors in estimation of gravitational-wave candidate significance

What to do when things get crowded? Scalable joint analysis of overlapping gravitational wave signals

Toward robust detections of nanohertz gravitational waves

Dynamic Normalization for Compact Binary Coalescence Searches in Non-Stationary Noise

Generalized Steppingstone Sampling: Efficient marginal likelihood estimation in gravitational wave analysis of Pulsar Timing Array data

When to Point Your Telescopes: Gravitational Wave Trigger Classification for Real-Time Multi-Messenger Followup Observations

Observational implications of lowering the LIGO-Virgo alert threshold

Calibrating gravitational-wave search algorithms with conformal prediction

Obtaining Statistical Significance of Gravitational Wave Signals in Hierarchical Search

A novel signal-consistency test for gravitational-wave searches of generic black hole binaries

A Test of Gravity with Pulsar Timing Arrays

Improved short-segment detection statistic for continuous gravitational waves