Abstract:Worldwide, fire disasters cause social, economic, and environmental damage, so their early detection and instant response is crucial for saving lives and property, which is possible via a soft computing approach. Researchers have therefore proposed different artificial intelligence-based approaches to detect fire at its early stages. However, several factors including domain shift problems, limited performance, and model complexity reduced their effectiveness in a real-world environment. To address these challenges, this study proposes an extensive data augmentation approach to tackle the domain shift problem by employing a mono-depth and atmospheric scattering model to generate and synthesise hazy, foggy, and night-time images. To further enhance the detection of small fire-affected areas, a refined DenseNet backbone is employed. This network is fine-tuned to extract intricate spatial details across different scales and establish meaningful connections between them. Subsequently, we introduce a soft attention mechanism into the backbone network. This entails utilising a 3D convolutional operation within the proposed attention framework to capture more extensive spatial features, which contributes to an enhanced discriminatory capability for detecting fire. Moreover, we have created a novel dataset explicitly designed for effective fire detection from a remote sensing perspective, known as the aerial drone and satellite fire (ADSF) dataset, encompasses images captured by drones and satellites. This broader range of image sources affords coverage across a wider expanse of geographical locations, surpassing the capabilities of CCTV cameras. Our proposed model achieves significant accuracy improvements, surpassing the state-of-the-art (SOTA) on both original and augmented datasets. For the Yar, FD, DFAN, and ADSF original datasets, we observed average accuracy increases of 1.25%, 1.95%, 2%, and 1.5%, respectively. In the comparisons with augmented versions of these datasets, our model consistently outperforms the SOTA, with accuracy improvements of 0.7, 1.97%, 1.42%, and 1.53%, respectively. Additionally, in our ablation studies, the proposed model excels in terms of both performance and resource efficiency. It achieves higher frame rates of 22.0, 72.5, and 7.0 FPS on CPU, GPU, and Raspberry Pi, respectively, with just 7.2 million learning parameters, making it well-suited for real-time deployment on edge devices. Finally, a Grad-CAM XAI method is utilised to visualise and highlight the most important regions in images emphasized by the model. The code and dataset are publicly available at https://github.com/Hikmat-Yar/ISPRS-Fire-Detection.

Hybrid CNN-ViT architecture to exploit spatio-temporal feature for fire recognition trained through transfer learning

CNN-Transformer Hybrid Architecture for Early Fire Detection

Spatio-Temporal Self-Attention Network for Fire Detection and Segmentation in Video Surveillance

A modified vision transformer architecture with scratch learning capabilities for effective fire detection

Fire Detection in Video Surveillances Using Convolutional Neural Networks and Wavelet Transform

Real-time Video Fire Smoke Detection by Utilizing Spatial-Temporal ConvNet Features.

A hybrid method for fire detection based on spatial and temporal patterns

Active Fire Detection Using a Novel Convolutional Neural Network Based on Himawari-8 Satellite Images

Deep Learning-Based Fire Detection for Enhanced Safety Systems

Vision Sensor-Based Real-Time Fire Detection in Resource-Constrained IoT Environments

Real Time Fire Detection using Deep Convolutional Neural Networks and Long-Short Term Memory in Video Surveillance

An Effective Attention-based CNN Model for Fire Detection in Adverse Weather Conditions

Multiscale network based on feature fusion for fire disaster detection in complex scenes

Development and evaluation of a vision-based transfer learning approach for indoor fire and smoke detection

An efficient deep learning architecture for effective fire detection in smart surveillance

Video Based Fire Detection Using Xception and Conv-LSTM

Forest Fire Segmentation via Temporal Transformer from Aerial Images

Fire Detection in Infrared Video Surveillance Based on Convolutional Neural Network and SVM

Wildfire danger prediction optimization with transfer learning

DATFNets-dynamic Adaptive Assigned Transformer Network for Fire Detection

Extraction and Classification of Image Features for Fire Recognition Based on Convolutional Neural Network