Abstract:We investigate the issue in determining the significance of candidate transient gravitational-wave events in a ground-based interferometer network. Given the presence of non-Gaussian noise artefacts in real data, the noise background must be estimated empirically from the data itself. However, the data also potentially contains signals, thus the background estimate may be overstated due to contributions from signals. It has been proposed to mitigate possible bias by removing single-detector data samples that pass a multi-detector consistency test from the background estimates. We conduct a high-statistics Mock Data Challenge to evaluate the effects of removing such samples, modelling a range of scenarios with plausible detector noise distributions and with a range of plausible foreground astrophysical signal rates. We consider the two different modes: one in which coincident samples are removed, and one in which all samples are retained and used. Three algorithms were operated in both modes, show good consistency with each other; however, discrepancies arise between the results obtained under the "coincidence removal" and "all samples" modes, for false alarm probabilities below a certain value. In most scenarios the median of the false alarm probability (FAP) estimator under the "all samples" mode is consistent with the exact FAP. On the other hand the "coincidence removal" mode is found to be unbiased for the mean of the estimated FAP. While the numerical values at which discrepancies become apparent are specific to the details of our experiment, we believe that the qualitative differences in the behaviour of the median and mean of the FAP estimator have more general validity. On the basis of our study we suggest that the FAP of candidates for the first detection of gravitational waves should be estimated without removing single-detector samples that form coincidences.

A Detection Threshold in the Amplitude Spectra Calculated from TESS Time-Series Data

False Alarm Rate based Statistical Detection Limit for Astronomical Photon Detectors

Detection Threshold Estimates for InSAR Time Series: A Simulation of Tropospheric Delay Approach

Detection Method for Small and Dim Targets from A Time Series of Images Observed by A Space-Based Optical Detection System

Tuning into spatial frequency space: Satellite and space debris detection in the ZTF alert stream

Systematic errors in estimation of gravitational-wave candidate significance

The correct estimate of the probability of false detection of the matched filter in the detection of weak signals. II. (Further results with application to a set of ALMA and ATCA data)

TIaRA TESS 1: estimating exoplanet yields from Years 1 and 3 SPOC light curves

A study of two periodogram algorithms for improving the detection of small transiting planets

Simulations Predicting the Ability of Multi-Color Simultaneous Photometry to Distinguish TESS Candidate Exoplanets from False Positives

DIAmante TESS AutoRegressive Planet Search (DTARPS): I. Analysis of 0.9 Million Light Curves

A TESS Search for Distant Solar System Objects: Yield Estimates

How far can we trust published TESS periods?

Confidence Level and Sensitivity Limits in High Contrast Imaging

Application of the Trend Filtering Algorithm in the search for multiperiodic signals

DIAmante TESS AutoRegressive Planet Search (DTARPS). I. Analysis of 0.9 Million Light Curves

Automated Nighttime Cloud Detection Using Keograms When Aurora Is Present

Periodicity significance testing with null-signal templates: Reassessment of PTF’s SMBH binary candidates

Detection of Thermal Emission at Millimeter Wavelengths from Low-Earth Orbit Satellites

False-alarm probability in relation to over-sampled power spectra, with application to Super-Kamiokande solar neutrino data

DEATHSTAR: A system for confirming planets and identifying false positive signals in TESS data using ground-based time domain surveys