Abstract:Worldwide, fire disasters cause social, economic, and environmental damage, so their early detection and instant response is crucial for saving lives and property, which is possible via a soft computing approach. Researchers have therefore proposed different artificial intelligence-based approaches to detect fire at its early stages. However, several factors including domain shift problems, limited performance, and model complexity reduced their effectiveness in a real-world environment. To address these challenges, this study proposes an extensive data augmentation approach to tackle the domain shift problem by employing a mono-depth and atmospheric scattering model to generate and synthesise hazy, foggy, and night-time images. To further enhance the detection of small fire-affected areas, a refined DenseNet backbone is employed. This network is fine-tuned to extract intricate spatial details across different scales and establish meaningful connections between them. Subsequently, we introduce a soft attention mechanism into the backbone network. This entails utilising a 3D convolutional operation within the proposed attention framework to capture more extensive spatial features, which contributes to an enhanced discriminatory capability for detecting fire. Moreover, we have created a novel dataset explicitly designed for effective fire detection from a remote sensing perspective, known as the aerial drone and satellite fire (ADSF) dataset, encompasses images captured by drones and satellites. This broader range of image sources affords coverage across a wider expanse of geographical locations, surpassing the capabilities of CCTV cameras. Our proposed model achieves significant accuracy improvements, surpassing the state-of-the-art (SOTA) on both original and augmented datasets. For the Yar, FD, DFAN, and ADSF original datasets, we observed average accuracy increases of 1.25%, 1.95%, 2%, and 1.5%, respectively. In the comparisons with augmented versions of these datasets, our model consistently outperforms the SOTA, with accuracy improvements of 0.7, 1.97%, 1.42%, and 1.53%, respectively. Additionally, in our ablation studies, the proposed model excels in terms of both performance and resource efficiency. It achieves higher frame rates of 22.0, 72.5, and 7.0 FPS on CPU, GPU, and Raspberry Pi, respectively, with just 7.2 million learning parameters, making it well-suited for real-time deployment on edge devices. Finally, a Grad-CAM XAI method is utilised to visualise and highlight the most important regions in images emphasized by the model. The code and dataset are publicly available at https://github.com/Hikmat-Yar/ISPRS-Fire-Detection.

Developing an Integrated Computer Vision Image Processing Technique to raise an Early Alarm for Fire Detection

Deep Learning Based Fire Detection System For Surveillance Videos

Real Time Fire Detection using Deep Convolutional Neural Networks and Long-Short Term Memory in Video Surveillance

Fire detection by using CNN Alex net Algorithm

FIRE IMAGE DETECTION USING CNN

Randomly Initialized CNN with Densely Connected Stacked Autoencoder for Efficient Fire Detection

Deep Learning-Based Fire Detection for Enhanced Safety Systems

Vision Sensor-Based Real-Time Fire Detection in Resource-Constrained IoT Environments

Efficient and Compact Convolutional Neural Network Architectures for Non-temporal Real-time Fire Detection

Fire Video Image Detection Based on a Convolutional Neural Network

A visualized fire detection method based on convolutional neural network beyond anchor

Improving Fire Detection Accuracy through Enhanced Convolutional Neural Networks and Contour Techniques

An Effective Attention-based CNN Model for Fire Detection in Adverse Weather Conditions

Real-Time Early Indoor Fire Detection and Localization on Embedded Platforms with Fully Convolutional One-Stage Object Detection

Fire Detection in Video Surveillances Using Convolutional Neural Networks and Wavelet Transform

An efficient deep learning architecture for effective fire detection in smart surveillance

Early Fire Detection Using Long Short-Term Memory-Based Instance Segmentation and Internet of Things for Disaster Management

Image fire detection algorithms based on convolutional neural networks

A convolutional neural network-based flame detection method in video sequence

Real-time fire detection network for intelligent surveillance systems

CNN-Transformer Hybrid Architecture for Early Fire Detection