Abstract:Currently, the spectra-based physical models and deep learning methods are frequently used to detect wildfires from remote sensing data. However, physical algorithms mainly rely on radiative transfer processes, which limit their effectiveness in detecting small and weak fires. On the other hand, deep learning methods usually lack mechanism constraints, thus generally resulting in false alarms of bright surfaces. It is promising to combine the advantages of them and correspondingly reduce the inherent error of a single algorithm. To this end, in this paper, both the local contextual and the global index method based on physical mechanisms are optimized, simultaneously, a new U-Net model is also establish to accurately detect fires. Moreover, YOLO v5 is incorporated for the first time to extract and remove the false alarms of objects with high exposure. Based on the above series of novel works, a self-adaptive fusing algorithm is finally proposed. Our results reveal that: (1) Short-wave infrared band of about 2.15 μm is crucial in fire detection for data with moderate-to-high resolutions. Taking Landsat 8 as an example, the band combinations of 7, 6, 2(SWIR + VI), 7, 6, 5(SWIR + NIR), and 7, 5, 3(SWIR + VI + NIR) show reasonable accuracy, with recall rate of greater than 81 %. The thermal infrared band can be used to assist in detecting the general location of the fire and serve as alternative choice in extreme cases. (2) The optimized physical algorithm can reduce false alarms and predict more accurate fire positions. (3) It is very effective to introduce the YOLO v5 framework to remove false alarms with high exposure in urban and suburban regions. (4) The proposed self-adaptive fusion algorithm integrates the advantages of various schemes, proving its better performance in terms of robustness, stability and generality compared to any single method. Even in extreme situations such as the Gobi Desert, thin cloud edges, and mountain shadow areas, the fusion algorithm still works well. The generality tests based on Sentinel-2A, WorldView-3, and SPOT-4 reveal the potential applicability of the newly proposed fusing algorithm, especially for data with fine spatial and spectral resolutions.

Forecasting backdraft with multimodal method: Fusion of fire image and sensor data

Vision Based Flame Detection Using Compressed Domain Motion Prediction and Multi-Feature Fusion.

A Study on Flame Detection Method Combining Visible Light and Thermal Infrared Multimodal Images

A Real-Time Fire Detection Method from Video with Multifeature Fusion

A combined real-time intelligent fire detection and forecasting approach through cameras based on computer vision method

Multi-Scale Video Flame Detection for Early Fire Warning Based on Deep Learning

Vision-Based Prediction of Flashover Using Transformers and Convolutional Long Short-Term Memory Model

Weakly Aligned Multimodal Flame Detection for Fire-Fighting Robots

P-Flash – A machine learning-based model for flashover prediction using recovered temperature data

A Fire-Alarming Method Based on Video Processing

Deep Learning Based Fire Detection System For Surveillance Videos

Automatic real-time fire distance, size and power measurement driven by stereo camera and deep learning

A modified vision transformer architecture with scratch learning capabilities for effective fire detection

A novel fire recognition algorithm based on flame's Multi-features Fusion

Research on Multi-Sensor Fusion Indoor Fire Perception Algorithm Based on Improved TCN

FireFormer: an Efficient Transformer to Identify Forest Fire from Surveillance Cameras

A self-adaptive wildfire detection algorithm by fusing physical and deep learning schemes

Modelling flame-to-fuel heat transfer by deep learning and fire images

Data-Driven Prediction Methods for Real-Time Indoor Fire Scenario Inferences

Fire image enhancement method based on generative adversarial networks for improving fire detection performance through cameras

An efficient model for real-time wildfire detection in complex scenarios based on multi-head attention mechanism