WIT-UAS: A Wildland-fire Infrared Thermal Dataset to Detect Crew Assets From Aerial Views

Andrew Jong,Mukai Yu,Devansh Dhrafani,Siva Kailas,Brady Moon,Katia Sycara,Sebastian Scherer
2023-12-15
Abstract:We present the Wildland-fire Infrared Thermal (WIT-UAS) dataset for long-wave infrared sensing of crew and vehicle assets amidst prescribed wildland fire environments. While such a dataset is crucial for safety monitoring in wildland fire applications, to the authors' awareness, no such dataset focusing on assets near fire is publicly available. Presumably, this is due to the barrier to entry of collaborating with fire management personnel. We present two related data subsets: WIT-UAS-ROS consists of full ROS bag files containing sensor and robot data of UAS flight over the fire, and WIT-UAS-Image contains hand-labeled long-wave infrared (LWIR) images extracted from WIT-UAS-ROS. Our dataset is the first to focus on asset detection in a wildland fire environment. We show that thermal detection models trained without fire data frequently detect false positives by classifying fire as people. By adding our dataset to training, we show that the false positive rate is reduced significantly. Yet asset detection in wildland fire environments is still significantly more challenging than detection in urban environments, due to dense obscuring trees, greater heat variation, and overbearing thermal signal of the fire. We publicize this dataset to encourage the community to study more advanced models to tackle this challenging environment. The dataset, code and pretrained models are available at \url{<a class="link-external link-https" href="https://github.com/castacks/WIT-UAS-Dataset" rel="external noopener nofollow">this https URL</a>}.
Computer Vision and Pattern Recognition,Robotics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to accurately detect important assets such as personnel and vehicles in the wildfire environment. Most of the existing datasets focus on object detection in urban environments, while datasets for wildfire environments are very scarce. This has led to the fact that detection models trained on existing datasets perform poorly in wildfire environments, especially in cases of high temperature, smoke occlusion and complex terrain, and these models are prone to a large number of false detections, that is, misidentifying flames as personnel or vehicles. To meet this challenge, the authors constructed a dataset named WIT - UAS (Wildland - fire Infrared Thermal Unmanned Aerial System dataset), which is specifically used for long - wave infrared sensors to detect personnel and vehicle assets in the wildfire environment. This dataset not only fills the gap in asset detection data in the wildfire environment, but also verifies through experiments that after adding this dataset, the false detection rate of the model can be significantly reduced and the detection accuracy can be improved. In addition, the authors also analyzed the characteristics of the dataset and explored possible future research directions, such as developing more advanced detection models and collecting more data in similar environments, to further enhance the safety and effectiveness of wildfire monitoring.