Abstract:Convolutional neural networks (CNN) have yielded state-of-the-art performance in image segmentation. Their application in video surveillance systems can provide very useful information for extinguishing fire in time. The current studies mostly focused on CNN-based flame image classification and have achieved good accuracy. However, the research of CNN-based flame region detection is extremely scarce due to the bulky network structures and high hardware configuration requirements of the state-of-the-art CNN models. Therefore, this paper presents a two-stream convolutional neural network for flame region detection (TSCNNFlame). TSCNNFlame is a lightweight CNN architecture including a spatial stream and temporal stream for detecting flame pixels in video sequences captured by fixed cameras. The static features from the spatial stream and dynamic features from the temporal stream are fused by three convolutional layers to reduce the false positives. We replace the convolutional layer of CNN with the selective kernel (SK)-Shuffle block constructed by integrating the SK convolution into the deep convolutional layer of ShuffleNet V2. The SKnet blocks can adaptively adjust the size of one receptive field with the proportion of one region of interest (ROI) in it. The grouped convolution used in Shufflenet solves the problem in which the multi-branch structure of SKnet causes the network parameters to double with the number of branches. Therefore, the CNN network dedicated to flame region detection balances the efficiency and accuracy by the lightweight architecture, the temporal–spatial features fusion, and the advantages of the SK-Shuffle block. The experimental results, which are evaluated by multiple metrics and are analyzed from many angles, show that this method can achieve significant performance while reducing the running time.

Fire Video Image Detection Based on a Convolutional Neural Network

A convolutional neural network-based flame detection method in video sequence

Deep Learning Based Fire Detection System For Surveillance Videos

Vision Based Flame Detection Using Compressed Domain Motion Prediction and Multi-Feature Fusion.

Video Fire Recognition Based on Multi-Channel Convolutional Neural Network

Video Flame Detection Method Based on Two-Stream Convolutional Neural Network

Forest fire image recognition based on convolutional neural network

A Two-Stream CNN Model with Adaptive Adjustment of Receptive Field Dedicated to Flame Region Detection

Extraction and Classification of Image Features for Fire Recognition Based on Convolutional Neural Network

Real Time Fire Detection using Deep Convolutional Neural Networks and Long-Short Term Memory in Video Surveillance

Fire Detection in Video Surveillances Using Convolutional Neural Networks and Wavelet Transform

Fire Detection in Infrared Video Surveillance Based on Convolutional Neural Network and SVM

Flame Detection in Surveillance

A Study on a Complex Flame and Smoke Detection Method Using Computer Vision Detection and Convolutional Neural Network

An efficient fire detection algorithm based on multi‐scale convolutional neural network

Information-Guided Flame Detection Based on Faster R-CNN

Multi-Scale Video Flame Detection for Early Fire Warning Based on Deep Learning

Real-time multi-feature based fire flame detection in video.

Image fire detection algorithms based on convolutional neural networks

Flame Detection Method Based on Regional Fully Convolutional Networks with Residual Network

Spatio-Temporal Self-Attention Network for Fire Detection and Segmentation in Video Surveillance