Abstract:Accurate fire load (combustible objects) information is crucial for safety design and resilience assessment of buildings. Traditional fire load acquisition methods, such as fire load survey, which are time-consuming, tedious, and error-prone, failed to adapt to dynamic changed indoor scenes. As a starting point of automatic fire load estimation, fast recognition and detection of indoor fire load are important. Thus, this research proposes a computer vision-based method to automatically detect indoor fire loads using deep learning-based instance segmentation. First, indoor elements are classified into different categories according to their material composition. Next, an image dataset of indoor scenes with instance annotations is developed. Finally, a deep learning model, based on Mask R-CNN, is developed and trained using transfer learning to detect fire loads in images. Experimental results show that our model achieves promising accuracy, as measured by an average precision (AP) of 40.5% and AP50 of 59.2%, for instance segmentation on the dataset. A comparison with manual detection demonstrates the method’s high efficiency as it can detect fire load 1200 times faster than humans. This research contributes to the body of knowledge 1) a novel method of high accuracy and efficiency for automated fire load recognition in indoor environments based on instance segmentation; 2) training techniques for a deep learning model in a relatively small dataset of indoor images which includes complex scenes and a variety of instances; and 3) an image dataset with annotations of indoor fire loads. Although instance segmentation has been applied for several years, this is a pioneering research on using it for automated indoor fire load recognition, which paves the foundation for automatic fire load estimation and resilience assessment for the built environment.

3D Location of Indoor Fire Ignition with a Multilevel Constraint Based on Monocular Vision

A Flame Localization Method Combing Visible-Light and Near-Infrared Cameras

Indoor fire detection utilizing computer vision-based strategies

Accurate and Fast Fire Alignment Method Based on a Mono-binocular Vision System

Unsupervised Segmentation of Fire and Smoke from Infra-Red Videos

Proposing a New Fire Diagram Training Method Using 3D Spatial Information and FDS

An Automatic Fire Searching and Suppression System for Large Spaces

A Fire Source Localization Algorithm Based on Temperature and Smoke Sensor Data Fusion

Development of early fire detection model for buildings using computer vision-based CCTV

2D-to-3D Projection for Monocular and Multi-View 3D Multi-class Object Detection in Indoor Scenes

Large-Scale 3D Semantic Mapping Using Monocular Vision

Automating Fire Detection and Suppression with Computer Vision: A Multi-Layered Filtering Approach to Enhanced Fire Safety and Rapid Response

Development and evaluation of a vision-based transfer learning approach for indoor fire and smoke detection

Deep Learning-Based Instance Segmentation for Indoor Fire Load Recognition

A Novel Indoor Positioning System for unprepared firefighting scenarios

A Feasible System of Automatic Flame Detection and Tracking for Fire-fighting Robot

A Vision-Based Detection and Spatial Localization Scheme for Forest Fire Inspection from UAV

SMOKE: Single-Stage Monocular 3D Object Detection via Keypoint Estimation

Indoor Scene Reconstruction From Monocular Video Combining Contextual and Geometric Priors

A Fast Video Fire Detection of Irregular Burning Feature in Fire-Flame Using in Indoor Fire Sensing Robots

An Indoor Autonomous Inspection and Firefighting Robot Based on SLAM and Flame Image Recognition