Abstract:Fire disasters pose a significant threat to human safety. Therefore, timely and effective fire detection is crucial for mitigating these threats. Combining visible light and thermal infrared for multimodal flame detection can fully utilize the visual and temperature distribution information of flames, potentially considerably enhancing the accuracy and robustness of flame detection methods. This approach is a highly promising detection method. However, the visible light and thermal infrared modalities differ fundamentally in imaging principles, pixel resolution, and texture information. Thus, effective fusion of these modalities becomes challenging. To address this issue, a novel flame detection method that integrates visible light and thermal infrared images is introduced. For the visible light modality, an overall model based on Mask R-CNN is designed, with ConvNeXt as the backbone, FPN as the neck, and a cascade structure as the detection head. Then, for the thermal infrared modality, to adapt to its weak semantic and strong texture features, we specifically modified the model's neck to better extract the underlying texture information of the image using the PAFPN structure. Furthermore, we designed a multimodal fusion algorithm using GIoU to fuse detection information from the visible light and thermal infrared modalities to address the weak alignment of detection targets in imaging principles, pixel resolution, and texture information. Experimental results on both public and self-collected datasets demonstrate that our proposed method outperforms other mainstream target detection networks in flame detection. Moreover, ablation experiments suggest that multimodal fusion significantly improves the overall performance of the algorithm. Specifically, our method achieves an accuracy of 85.33, a recall of 99.33, and an F1 score of 90.03.

Information-Guided Flame Detection Based on Faster R-CNN

Vision Based Flame Detection Using Compressed Domain Motion Prediction and Multi-Feature Fusion.

Fire Video Image Detection Based on a Convolutional Neural Network

Flame Detection Method Based on Regional Fully Convolutional Networks with Residual Network

A Study on Flame Detection Method Combining Visible Light and Thermal Infrared Multimodal Images

A convolutional neural network-based flame detection method in video sequence

Anchor-Free Smoke and Flame Recognition Algorithm with Multi-Loss

Real-time multi-feature based fire flame detection in video.

A Flame Localization Method Combing Visible-Light and Near-Infrared Cameras

Towards a solid solution of real-time fire and flame detection

A Two-Stream CNN Model with Adaptive Adjustment of Receptive Field Dedicated to Flame Region Detection

Flame Detection Using Deep Learning

A Fire-Alarming Method Based on Video Processing

Flame Detection Algorithm Based on Image Processing Technology

Multi-Scale Video Flame Detection for Early Fire Warning Based on Deep Learning

Weakly Aligned Multimodal Flame Detection for Fire-Fighting Robots

Image fire detection algorithms based on convolutional neural networks

A Forest Fire Detection Method Based on Adaptive Feature Fusion Module

Complex Scenes Fire Object Detection Based on Feature Fusion and Channel Attention

A Real-Time Fire Detection Method from Video with Multifeature Fusion

A Study on a Complex Flame and Smoke Detection Method Using Computer Vision Detection and Convolutional Neural Network