Abstract:Fused Magnesium Furnace (FMF) is a crucial industrial equipment in the production of magnesia, and anomaly detection plays a pivotal role in ensuring its efficient, stable, and secure operation. Existing anomaly detection methods primarily focus on analyzing dominant anomalies using the process variables (such as arc current) or constructing neural networks based on abnormal visual features, while overlooking the intrinsic correlation of cross-modal information. This paper proposes a cross-modal Transformer (dubbed FmFormer), designed to facilitate anomaly detection in fused magnesium smelting processes by exploring the correlation between visual features (video) and process variables (current). Our approach introduces a novel tokenization paradigm to effectively bridge the substantial dimensionality gap between the 3D video modality and the 1D current modality in a multiscale manner, enabling a hierarchical reconstruction of pixel-level anomaly detection. Subsequently, the FmFormer leverages self-attention to learn internal features within each modality and bidirectional cross-attention to capture correlations across modalities. To validate the effectiveness of the proposed method, we also present a pioneering cross-modal benchmark of the fused magnesium smelting process, featuring synchronously acquired video and current data for over 2.2 million samples. Leveraging cross-modal learning, the proposed FmFormer achieves state-of-the-art performance in detecting anomalies, particularly under extreme interferences such as current fluctuations and visual occlusion caused by heavy water mist. The presented methodology and benchmark may be applicable to other industrial applications with some amendments. The benchmark will be released at <a class="link-external link-https" href="https://github.com/GaochangWu/FMF-Benchmark" rel="external noopener nofollow">this https URL</a>.

Skip-CBAM Based Unsupervised Anomaly Detection of Fused Magnesia Furnace

Data anomaly detection for structural health monitoring using a combination network of GANomaly and CNN

An Unsupervised Fault Monitoring Framework for Blast Furnace: Information Extraction Enhanced GRU-GMM-autoencoder

Cross-Modal Learning for Anomaly Detection in Fused Magnesium Smelting Process: Methodology and Benchmark

Video-based Working Condition Recognition of Fused Magnesium Furnace with Stochastic Configuration Networks

Fault Detection Method for Blast Furnace Based on Small-sample Fault Data Generation

SCA-GANomaly: an unsupervised anomaly detection model of high-speed railway catenary components

Dam safety assessment through data-level anomaly detection and information fusion

MFGAN: Multimodal Fusion for Industrial Anomaly Detection Using Attention-Based Autoencoder and Generative Adversarial Network

Process Operation Performance Assessment Based on Multi-source Heterogeneous Information with Semi-supervised Transfer Generative Adversarial Network for Electro-fused Magnesium Furnace

Process Monitoring Model for Fused Magnesia Smelting Process Based on Feature Extraction With Reduced Inter-Variable Correlation

Industrial surface defect detection and localization using multi-scale information focusing and enhancement GANomaly

Self-healing control of abnormal conditions for fused magnesium furnace based on data augmentation and improved JITL

Abnormality Detection of Blast Furnace Ironmaking Process Based on an Improved Diffusion Convolutional Gated Recurrent Unit Network.

FFA-GAN: A Generative Adversarial Network Based on Feature Fusion Attention for Intelligent Safety Monitoring

Improving Pipeline Magnetic Flux Leakage (MFL) Detection Performance With Mixed Attention Mechanisms (AMs) and Deep Residual Shrinkage Networks (DRSNs)

Self-Supervised Guided Segmentation Framework for Unsupervised Anomaly Detection

MFAM-AD: an anomaly detection model for multivariate time series using attention mechanism to fuse multi-scale features

Self-Supervised Texture Image Anomaly Detection by Fusing Normalizing Flow and Dictionary Learning

Few-shot Message-Enhanced Contrastive Learning for Graph Anomaly Detection

FL-MGVN: Federated learning for anomaly detection using mixed gaussian variational self-encoding network