Mutiple-Frame Refining Detection Network for Real-Time Smoke Detection

Ji Yu Wang,Qiang Wang,Jin Tao Zhang
DOI: https://doi.org/10.2139/ssrn.4217294
2022-01-01
SSRN Electronic Journal
Abstract:Smoke detection is essential to us due to its life-threatening. Traditional strategies are usually applied to existing popular detection methods for smoke feature extraction, and their combinations are fed into a convolutional neural networks (CNN) classification model. However, these methods are not only restricted to limited scenarios, but more importantly, they have high false alarm rate (FAR) and hard to realize real-time performance. In this paper, we propose a Multiple-Frame Refining Detection Network, namely MUFRDN. Our MUFRDN is mainly proposed for real-time smoke detection, reducing FAR and increasing the applicable scenarios of smoke detection. The contribution of this work is that we are the first to combine Multiple-Frame image classification with object detection for smoke detection. Specifically, YOLOv5 is utilized for bounding box generation by extracting a large number of potential smoke areas. Then frame-difference images are obtained by Multiple-Frame and sent to a modified network based on ShuffleNetv2 for final smoke classification. The experimental results are evaluated on three public smoke datasets and our datasets. Offline experiments show that the proposed method can achieve a FAR of only 0.74$\%$ and detection rate (DR) of 96.2$\%$. Furthermore, the real-time detection rate can reach 248 frame per second (FPS), which is about 3.43 times the fastest video detection algorithm. Meanwhile, the FAR of online smoke detection on embedded devices is only about 0.042$\%$ and the DR is 100$\%$ for 400 smoke-making test videos.
What problem does this paper attempt to address?