Abstract:This paper presents a sequential learning method aimed at improving the performance of a lightweight deep learning model used for detecting fires at an early stage in surveillance video streams. The proposed approach involves a sequence of supervised learning steps, wherein the entire training dataset is partitioned into multiple sub-datasets based on the size of fire objects. The size of fire objects is measured by object size ratio, which is the ratio of the bounding box area of the detected fire flame object relative to the entire image area. The initial training sub-dataset contains the largest-sized fire objects, progressing to the final sub-dataset containing the smallest-sized fire objects. The objective is to employ sequential learning to enhance the detection of small-sized fire objects relative to the image area using a lightweight model suitable for edge computing devices. Experiment results demonstrate that a deep learning fire detection model trained sequentially with a descending order of object size can effectively detect small flame objects with an object size ratio less than 0.006, achieving an F1 score of 93.1%, representing a 27% improvement compared to traditional supervised learning with no sequential learning steps. Additionally, performance in detecting tiny flame objects with an object size ratio less than 0.0016 achieves an F1 score of 94.5%, showing a 17.5% increase compared to the baseline without sequential learning.

What problem does this paper attempt to address?

The main objective of this paper is to propose a new method to improve the performance of flame object recognition in early fire detection systems, especially the ability to detect small-sized flames in surveillance video streams. To achieve this goal, the researchers developed a sequence learning-based approach to train lightweight deep learning models. Specifically, the study addresses the following key issues: 1. **Challenges in Early Fire Detection**: Early fires are often small and difficult to detect using traditional monitoring methods, which may be inefficient, costly, and prone to human error. 2. **Limitations of Existing Technologies**: Although existing deep learning-based methods have made progress in improving fire detection accuracy, they still face challenges in detecting small flames when running on edge computing devices, especially while maintaining high performance with lightweight models. 3. **Optimization of Small-Sized Flame Detection**: Detecting small flames is particularly challenging because they occupy a small proportion of the image and are easily misjudged or missed. To address the above issues, the authors propose the following contributions: 1. **Sequence Learning Framework**: The entire training dataset is divided into multiple subsets according to the size of the flame objects, and these subsets are trained sequentially to enhance the model's ability to detect small-sized flames. 2. **Reduction of False Positives**: By gradually reducing false positives through multiple learning cycles, especially for small flames in the early stages, the response speed to fire events is accelerated. 3. **Empirical Formula for Determining the Number of Learning Cycles**: An empirical method is proposed to determine how many sequence learning cycles are needed to effectively detect flame objects of specific sizes. Experimental results show that deep learning models trained with sequence learning can significantly improve the detection performance of small-sized flame objects compared to traditional supervised learning, particularly in terms of reducing false positives. This indicates that the proposed method is very effective in improving the performance of early fire detection systems.

Sequential Learning of Flame Objects Sorted by Size for Early Fire Detection in Surveillance Videos

Deep Learning Based Fire Detection System For Surveillance Videos

Level Set Based Flame Segmentation

Flame Detection Using Deep Learning

Multi-Scale Video Flame Detection for Early Fire Warning Based on Deep Learning

Towards a solid solution of real-time fire and flame detection

Dynamic smoke detection by eliminating static targets in video

Early Stage Fire Detection System Based on Shallow Guide Deep Network

An efficient deep learning architecture for effective fire detection in smart surveillance

Flame Detection in Electric Power Scenarios Based on Gaussian Modeling

Real-time multi-feature based fire flame detection in video.

Multiple Flames Recognition Using Deep Learning

Flame Detection in Surveillance

Fully Synthetic Videos and the Random-Background-Pasting Method for Flame Segmentation

Spatio-Temporal Self-Attention Network for Fire Detection and Segmentation in Video Surveillance

A deep learning-based dynamic deformable adaptive framework for locating the root region of the dynamic flames

Image-Based Real-Time Fire Detection using Deep Learning with Data Augmentation for Vision-Based Surveillance Applications

Fire-YOLO: A Small Target Object Detection Method for Fire Inspection

Robust Forest Fire Detection Method for Surveillance Systems Based on You Only Look Once Version8 and Transfer Learning Approaches

Object Detection through Fires Using Violet Illumination Coupled with Deep Learning

Multi-Scale Flame Situation Detection Based on Pixel-Level Segmentation of Visual Images