Real‐time fire and smoke detection with transfer learning based on cloud‐edge collaborative architecture

Ming Yang,Songrong Qian,Xiaoqin Wu
DOI: https://doi.org/10.1049/ipr2.13187
IF: 2.3
2024-07-23
IET Image Processing
Abstract:This paper introduces a novel cloud‐edge collaborative architecture for real‐time fire and smoke detection, featuring an iterative transfer learning approach based on user feedback to enhance adaptability. Employing the YOLOv8 algorithm with improved data augmentation and the coordinate attention mechanism for global feature extraction, the proposed model exhibits a 2‐point accuracy boost. After three rounds of transfer learning, improved results are achieved. Recent years have seen increased interest in object detection‐based applications for fire detection in digital images and videos from edge devices. The environment's complexity and variability often lead to interference from factors such as fire and smoke characteristics, background noise, and camera settings like angle, sharpness, and exposure, which hampers the effectiveness of fire detection applications. Limited picture data for fire and smoke scenes further challenges model accuracy and robustness, resulting in high false detection and leakage rates. To address the need for efficient detection and adaptability to various environments, this paper focuses on (1) proposing a cloud‐edge collaborative architecture for real‐time fire and smoke detection, incorporating an iterative transfer learning strategy based on user feedback to enhance adaptability; (2) improving the detection capabilities of the base model YOLOv8 by enhancing the data augmentation method and introducing the coordinate attention mechanism to improve global feature extraction. The improved algorithm shows a 2‐point accuracy increase. After three iterations of transfer learning in the production environment, accuracy improves from 93.3% to 96.4%, and mAP0.5:0.95 increases by nearly 5 points. This program effectively addresses false detection issues in fire and smoke detection systems, demonstrating practical applicability.
computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology
What problem does this paper attempt to address?