Abstract:Timely fire alarms are crucial as they can save lives and avoid major economic losses. However, due to the complexity of the structure, the current mainstream DETR-based fire detection models are problematic in terms of practicality because they require large amounts of memory and long inference times. Meanwhile, high-quality fire detection datasets are very scarce, severely limiting the performance of the algorithms. To address these challenges and improve accuracy in complex fire environments, first, we introduce a dataset quality enhancement framework based on diffusion model (DDPM) to improve the quality of low-quality fire alarm datasets. Second, we propose a novel Deformable-DETR-based fire detection framework (FTA-DETR). Among the innovative optimizations of FTA-DETR, first, we introduce a trainable matrix in the encoder to compute features, which reduces the computational burden of the encoder, highlights compelling features, and significantly reduces the training time. Second, we improve the encoding block by alternately updating high-level and low-level features, greatly reducing the amount of feature computation required for effective detection. This encoder structure is compatible with any state-of-the-art transformer decoder. Next, to accommodate the multi-scale nature of fires and different environmental complexities, we modify the loss function to WiouV3, which not only speeds up the convergence of the model but also improves the performance. Finally, we smoothly combine FTA-DETR with an acceleration engine like TensorRT to improve inference speed with little loss of accuracy. The experiments show that the dataset quality enhancement framework based on the diffusion model generates high quality datasets, and the enhanced dataset can greatly improve the detection performance of FTA-DETR (mAP increased by 2.42%). Meanwhile, FTA-DETR outperforms almost all current fire detection frameworks in terms of detection accuracy and interference resistance, with accuracy reaching 98.32% and 99.21% on the two datasets, Mivia and FireNet, respectively, and precision reaching 94% on the BoWFire dataset. In addition, FTA-DETR after being paired with the TensorRT framework achieves an inference speed of 76 FPS on the Jetson Orin Nano, a small embedded device with very limited computational power. The code is available at https://github.com/wanggoat/FTA-detr .

FSH-DETR: An Efficient End-to-End Fire Smoke and Human Detection Based on a Deformable DEtection TRansformer (DETR)

A Small-Target Forest Fire Smoke Detection Model Based on Deformable Transformer for End-to-End Object Detection

An efficient fire and smoke detection algorithm based on an end-to-end structured network

FTA-DETR: An efficient and precise fire detection framework based on an end-to-end architecture applicable to embedded platforms

Deep Learning Based Fire Detection System For Surveillance Videos

FSDF: A High-Performance Fire Detection Framework.

Fire and Smoke Detection with Burning Intensity Representation

A Multi-Scale Approach to Early Fire Detection in Smart Homes

FireNet: A Lightweight and Efficient Multi-Scenario Fire Object Detector

ASFD: Automatic and Scalable Face Detector

Smoke Detection Algorithm Based on Improved EfficientDet

Real-Time Smoke Detection with Split Top-k Transformer and Adaptive Dark Channel Prior in Foggy Environments

Complex Scenes Fire Object Detection Based on Feature Fusion and Channel Attention

Real-time Human Detection in Fire Scenarios using Infrared and Thermal Imaging Fusion

Real-Time Fire Smoke Detection Method Combining a Self-Attention Mechanism and Radial Multi-Scale Feature Connection

ADFireNet: An Anchor-Free Smoke and Fire Detection Network Based on Deformable Convolution

An enhanced relation-aware global-local attention network for escaping human detection in indoor smoke scenarios

Deepfirenet: A Real-Time Video Fire Detection Method Based On Multi-Feature Fusion

Mutiple-Frame Refining Detection Network for Real-Time Smoke Detection

Lite DETR : An Interleaved Multi-Scale Encoder for Efficient DETR

FSDNet-An efficient fire detection network for complex scenarios based on YOLOv3 and DenseNet