Online Monitoring of High-Dimensional Binary Data Streams with Application to Extreme Weather Surveillance

Zhiwen Fang,Wendong Li,Xin Liu,Xiaolong Pu,Dongdong Xiang
DOI: https://doi.org/10.1080/02664763.2021.1971633
IF: 1.416
2021-01-01
Journal of Applied Statistics
Abstract:With the rapid development of modern sensor technology, high-dimensional data streams appear frequently nowadays, bringing urgent needs for effective statistical process control (SPC) tools. In such a context, the online monitoring problem of high-dimensional and correlated binary data streams is becoming very important. Conventional SPC methods for monitoring multivariate binary processes may fail when facing high-dimensional applications due to high computational complexity and the lack of efficiency. In this paper, motivated by an application in extreme weather surveillance, we propose a novel pairwise approach that considers the most informative pairwise correlation between any two data streams. The information is then integrated into an exponential weighted moving average (EWMA) charting scheme to monitor abnormal mean changes in high-dimensional binary data streams. Extensive simulation study together with a real-data analysis demonstrates the efficiency and applicability of the proposed control chart.
What problem does this paper attempt to address?