Tutorial on running median subtraction filter with application to searches for exotic field transients in multi-messenger astronomy

Arko P. Sen,Andrey Sarantsev,Geoffrey Blewitt,Andrei Derevianko

2024-10-03

Abstract:Running Median Subtraction Filter (RMSF) is a robust statistical tool for removing slowly varying baselines in data streams containing transients (short-duration signals) of interest. In this work, we explore the RMSF performance and properties using simulated time series and analytical methods. We study the RMSF fidelity in preserving the signal of interest in the data using (i) a Gaussian pulse and (ii) a transient oscillatory signal. Such signals may be generated by hypothetical exotic low-mass fields (ELFs) associated with intense astrophysical events like binary black hole or neutron star mergers. We consider and assess RMSF as a candidate method to extract transient ELF signals. RMSF operates by sliding a window across the data and subtracting the median value within each window from the data points. With a suitable choice of running window size, RMSF effectively filters out baseline variations without compromising the integrity of transients. The RMSF window width is a critical parameter: it must be wide enough to encompass a short transient but narrow enough to remove the slowly varying baseline. We show that the RMSF removes the mean of a normally distributed white noise while preserving its variance and higher order moments in the limit of large windows. In addition, RMSF does not color the white noise stream, i.e., it does not induce any significant correlation in the filtered data. Ideally, a filter would preserve both the signal of interest and the statistical characteristics of the stochastic component of the data, while removing the background clutter and outliers. We find the RMSF to satisfy these practical criteria for data pre-processing. While we rigorously prove several RMSF properties, the paper is organized as a tutorial with multiple illustrations of RMSF applications.

Instrumentation and Methods for Astrophysics,Data Analysis, Statistics and Probability

What problem does this paper attempt to address?

### What problems does this paper attempt to solve?

This paper aims to explore and evaluate the effectiveness and performance of the **Running Median Subtraction Filter (RMSF)** in detecting transient signals of Exotic Low - Mass Fields (ELFs) in multi - messenger astronomy. Specifically, the paper mainly addresses the following problems:

1. **Removing slowly - varying background noise**:
- In experimental data, transients are usually accompanied by slowly - varying background noise (baseline clutter). This background noise can interfere with the detection of the target transient signals. As a non - linear filter, RMSF can effectively remove this background noise without significantly distorting the transient signals.

2. **Preserving the integrity of transient signals**:
- Transient signals refer to short - term fluctuations or patterns in the data stream. They are temporary and do not represent long - term trends. The goal of RMSF is to preserve the integrity of these transient signals to the greatest extent while removing background noise.

3. **Handling Gaussian pulse and oscillating transient signals**:
- The paper uses two types of transient signals for testing: (i) Gaussian pulse signals and (ii) oscillating transient signals. These signals may be generated by the hypothesized Exotic Low - Mass Fields (ELFs) and are associated with strong astrophysical events such as binary black hole or neutron star mergers.

4. **Optimizing the selection of window width**:
- The key parameter of RMSF is the width of the running window. The window width must be wide enough to include the transient signal, but not too wide to effectively remove the slowly - varying background. The paper determines the optimal window width through numerical experiments.

5. **Comparison with other filters**:
- The paper compares RMSF with another commonly used filter - the Running Average Subtraction Filter (RASF). The results show that RMSF performs better in removing background noise and preserving transient signals.

### Formula summary

- **Sample mean**:
\[
\bar{x}=\frac{1}{N}\sum_{j = 1}^{N}x_j
\]

- **Sample median**:
\[
\text{Median}\left\{x_j\right\}_{j = 1}^N=\begin{cases}x_{\left(\frac{N + 1}{2}\right)},&\text{if }N\text{ is odd}\\\frac{1}{2}\left(x_{\left(\frac{N}{2}\right)}+x_{\left(\frac{N}{2}+1\right)}\right),&\text{if }N\text{ is even}\end{cases}
\]

- **RMSF calculation formula**:
\[
\tilde{x}_k=x_k-\text{Median}\left\{x_j\right\}_{j = k - M}^{k + M}
\]
where \(M=\frac{N_w-1}{2}\), and \(N_w\) is the window size.

- **RASF calculation formula**:
\[
x'_k=x_k-\frac{1}{N_w}\sum_{j = k - M}^{k + M}x_j
\]

Through these methods, the paper demonstrates the potential of RMSF in detecting transient signals of Exotic Low - Mass Fields in multi - messenger astronomy and provides theoretical and technical support for future research.