Abstract:Aim Fires are a serious threat to people's lives and property. Detecting fires quickly and effectively and extinguishing them in the nascent stage is an effective way to reduce fire hazards. Currently, deep learning-based fire detection algorithms are usually deployed on the PC side. Methods After migrating to small embedded devices, the accuracy and speed of recognition are degraded due to the lack of computing power. In this paper, we propose a real-time fire detection algorithm based on MobileNetV3-large and yolov4, replacing CSP Darknet53 in yolov4 with MobileNetV3-large to achieve the initial extraction of flame and smoke features while greatly reducing the computational effort of the network structure. A path connecting PANet was explored on Gbneck(104, 104, 24), while SPP was embedded in the path from MobileNetV3 to PANet to improve the feature extraction capability for small targets; the PANet in yolo4 was improved by combining the BiFPN path fusion method, and the improved PANet further improved the feature extraction capability; the Vision Transformer model is added to the backbone feature extraction network and PANet of the YOLOv4 model to give full play to the model's multi-headed attention mechanism for pre-processing image features; adding ECA Net to the head network of yolo4 improves the overall recognition performance of the network. Result These algorithms run well on PC and reach 95.14% recognition accuracy on the public dataset BoWFire. Finally, these algorithms were migrated to the Jeston Xavier NX platform, and the entire network was quantized and accelerated with the TensorRT algorithm. With the image propagation function of the fire robot, the overall recognition frame rate can reach about 26.13 with high real-time performance while maintaining a high recognition accuracy. Conclusion Several comparative experiments have also validated the effectiveness of this paper's improvements to the YOLOv4 algorithm and the superiority of these structures. With the effective integration of these components, the algorithm shows high accuracy and real-time performance.

A visualized fire detection method based on convolutional neural network beyond anchor

Deep Learning Based Fire Detection System For Surveillance Videos

Image fire detection algorithms based on convolutional neural networks

Real-Time Early Indoor Fire Detection and Localization on Embedded Platforms with Fully Convolutional One-Stage Object Detection

An Indoor Fire Detection Method Based on Multi-Sensor Fusion and a Lightweight Convolutional Neural Network

Fire Detection in Video Surveillances Using Convolutional Neural Networks and Wavelet Transform

A Robust Fire Detection Model via Convolution Neural Networks for Intelligent Robot Vision Sensing

Fire Video Image Detection Based on a Convolutional Neural Network

Improving Fire Detection Accuracy through Enhanced Convolutional Neural Networks and Contour Techniques

FireNet: A Lightweight and Efficient Multi-Scenario Fire Object Detector

Spatio-Temporal Self-Attention Network for Fire Detection and Segmentation in Video Surveillance

Research and Comparison of Fire Detection Models Based on Deep Learning and Mixed Dataset

Efficient and Compact Convolutional Neural Network Architectures for Non-temporal Real-time Fire Detection

Real-time fire detection algorithms running on small embedded devices based on MobileNetV3 and YOLOv4

An efficient fire detection algorithm based on multi‐scale convolutional neural network

ADFireNet: An Anchor-Free Smoke and Fire Detection Network Based on Deformable Convolution

Developing an Integrated Computer Vision Image Processing Technique to raise an Early Alarm for Fire Detection

FSDNet-An efficient fire detection network for complex scenarios based on YOLOv3 and DenseNet

Complex Scenes Fire Object Detection Based on Feature Fusion and Channel Attention

An Improved YOLOv5s Fire Detection Model

Distinguishable method for video fire detection