Abstract:Innovative engineering solutions that are efficient, quick, and simple to use are crucial given the rapid industrialization and technology breakthroughs in Industry 5.0. One of the areas receiving attention is the rise in gas leakage accidents at coal mines, chemical companies, and home appliances. To prevent harm to both the environment and human lives, rapid and automated detection and identification of the gas type is necessary. Most of the previous studies used a single mode of data to perform the detection process. However, instead of using a single source/mode, multimodal sensor fusion offers more accurate results. Furthermore, the majority used individual feature extraction approaches that extract either spatial or temporal information. This paper proposes a deep learning-based (DL) pipeline to combine multimodal data acquired via infrared (IR) thermal imaging and an array of seven metal oxide semiconductor (MOX) sensors forming an electronic nose (E-nose). The proposed pipeline is based on three convolutional neural networks (CNNs) models for feature extraction and bidirectional long-short memory (Bi-LSTM) for gas detection. Two multimodal data fusion approaches are used, including intermediate and multitask fusion. Discrete wavelet transform (DWT) is utilized in the intermediate fusion to combine the spatial features extracted from each CNN, providing spectral–temporal representation. In contrast, in multitask fusion, the discrete cosine transform (DCT) is used to merge all of the features obtained from the three CNNs trained with the multimodal data. The results show that the proposed fusion approach has boosted the gas detection performance reaching an accuracy of 98.47% and 99.25% for intermediate and multitask fusion, respectively. These results indicate that multitask fusion is superior to intermediate fusion. Therefore, the proposed system is capable of detecting gas leakage accurately and could be used in industrial applications.

Multi-scale Receptive Field Grouped and Split Attention Network for Real-time Detection of Hazardous Chemical Gas Leaks in Infrared Images

MWIRGas-YOLO: Gas Leakage Detection Based on Mid-Wave Infrared Imaging

A Novel Intelligent Online Fire Monitoring Approach for Underground Pipe Galleries

Advanced Computer Vision-Based Subsea Gas Leaks Monitoring: A Comparison of Two Approaches

Third-party Construction Intrusion Detection of Natural Gas Pipelines Based on Improved YOLOv5

Invisible Gas Detection: An RGB-Thermal Cross Attention Network and A New Benchmark

GLRNet: Gas Leak Recognition via Temporal Difference in Infrared Video

YOLO-PD: Abnormal signal detection in gas pipelines based on improved YOLOv7

Machine vision for natural gas methane emissions detection using an infrared camera

A Lightweight Network Based on Local-Global Feature Fusion for Real-Time Industrial Invisible Gas Detection with Infrared Thermography

YOLO-GP: A Multi-Scale Dangerous Behavior Detection Model Based on YOLOv8

A Multilevel Interleaved Group Attention-Based Convolutional Network for Gas Detection Via an Electronic Nose System

An E-nose system for identification and quantification of hazardous gas mixtures using a combined strategy of CNNs and attentional mechanisms

Fire Safety Detection Based on CAGSA-YOLO Network

Multimodal Fusion Induced Attention Network for Industrial VOCs Detection

Gas Plume Target Detection in Multibeam Water Column Image Using Deep Residual Aggregation Structure and Attention Mechanism.

Efficient Gas Leak Simulation Surrogate Modeling and Super Resolution for Gas Detector Placement Optimization

Multitask Deep Learning-Based Pipeline for Gas Leakage Detection via E-Nose and Thermal Imaging Multimodal Fusion

Multi-gas pollutant detection based on sparrow search algorithm optimized ALSTM-FCN

Gas Leakage Recognition Based on Wide-Band Infrared Imaging with the Auxiliary Excitation Method and Machine Learning Model

Improved Object Detection Network for Pipeline Leakage Localization in the Pneumatic System Based on Thermal Images