A New 3-D Error Diagram for a More Balanced Assessment of Binary Alarms for Predicting Earthquakes: Application to TIR Anomalies in Sichuan Area, China

Zhang Ying,Didier Sornette,Meng Qingyan
DOI: https://doi.org/10.1109/tgrs.2023.3293132
IF: 8.2
2023-07-22
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Designed to quantify the value of alarm-based earthquake predictions, the Molchan diagram only compares the false-negative rate (FNR) to the expected number of target events in the alerted time–space volume (ATSV) while ignoring essential performance metrics such as the false discovery rate (FDR). The FDR is the ratio of alarms that do not correspond to any earthquake to the total number of alarms and quantifies the credibility of alarms. Strategies only minimizing the FNR can lead to too many false positive alarms, leading to mistrust in them. In this study, a new significance test for alarms based on their FDR is constructed. We construct a new 3-D error diagram, where the -axis is the relative spatiotemporal coverage of alarms, the -axis is the FNR, and the -axis is the FDR. The strategy of the 3-D error diagram is to balance the cost of alarms, the losses brought by missed events, and the additional negative impact brought by alarms with low credibility. Using the new 3-D error diagram and a simple time series analysis for extracting thermal infrared (TIR) anomalies (TIRAs), we show that the 11-year TIRAs in the Sichuan area are strongly statistically related to earthquakes with magnitude from the view of events and alarms and that the score provided by our 3-D error diagram is more consistent and robust than the 2-D original Molchan diagram so that the new method effectively helps finding more balanced alarms.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?