A Lightning Optical Automatic Detection Method Based on a Deep Neural Network

Jialei Wang,Lin Song,Qilin Zhang,Jie Li,Quanbo Ge,Shengye Yan,Gaofeng Wu,Jing Yang,Yuqing Zhong,Qingda Li
DOI: https://doi.org/10.3390/rs16071151
IF: 5
2024-03-27
Remote Sensing
Abstract:To achieve automatic recognition of lightning images, which cannot easily be handled using the existing methods and still requires significant human resources, we propose a lightning image dataset and a preprocessing method. The lightning image data over five months were collected using a camera based on two optical observation stations, and then a series of batch labeling methods were applied, which greatly reduced the workload of subsequent manual labeling, and a dataset containing more than 30,000 labeled samples was established. Considering that lightning varies rapidly over time, we propose a time sequence composite (TSC) preprocessing method that inputs lightning's time-varying characteristics into a model for better recognition of lightning images. The TSC method was evaluated through an experiment on four backbones, and it was found that this preprocessing method enhances the classification performance by 40%. The final trained model could successfully distinguish between the "lightning" and "non-lightning" samples, and a recall rate of 86.5% and a false detection rate of 0.2% were achieved.
environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
What problem does this paper attempt to address?
### The Problem the Paper Attempts to Solve This paper aims to address the issue of automatic lightning image recognition. Existing methods face difficulties in handling lightning images and require a significant amount of human resources for manual annotation. The automatic recognition of lightning images is highly complex due to the following reasons: 1. **Unstable Lightning Shapes**: Lightning is an intense luminous ion channel with highly random appearance locations and channel shapes. 2. **Weather Impact**: Weather conditions such as strong winds and heavy rain can cause image shake and distortion. 3. **Optical Signal Scattering**: Lightning may be partially or completely obscured by clouds or rain curtains. 4. **Interference from Moving Objects**: Moving objects such as birds, insects, and human activities add to the complexity of the problem. To overcome these challenges, the authors propose an automatic lightning image detection method based on deep neural networks (DNN). Specifically, they constructed a lightning image dataset containing over 30,000 annotated samples and proposed a Time Series Composite (TSC) preprocessing method to better capture the temporal variation characteristics of lightning. Through these methods, the final trained model successfully distinguishes between "lightning" and "non-lightning" samples, achieving a high recall rate (86.5%) and a low false detection rate (0.2%).