Abstract:Fused Magnesium Furnace (FMF) is a crucial industrial equipment in the production of magnesia, and anomaly detection plays a pivotal role in ensuring its efficient, stable, and secure operation. Existing anomaly detection methods primarily focus on analyzing dominant anomalies using the process variables (such as arc current) or constructing neural networks based on abnormal visual features, while overlooking the intrinsic correlation of cross-modal information. This paper proposes a cross-modal Transformer (dubbed FmFormer), designed to facilitate anomaly detection in fused magnesium smelting processes by exploring the correlation between visual features (video) and process variables (current). Our approach introduces a novel tokenization paradigm to effectively bridge the substantial dimensionality gap between the 3D video modality and the 1D current modality in a multiscale manner, enabling a hierarchical reconstruction of pixel-level anomaly detection. Subsequently, the FmFormer leverages self-attention to learn internal features within each modality and bidirectional cross-attention to capture correlations across modalities. To validate the effectiveness of the proposed method, we also present a pioneering cross-modal benchmark of the fused magnesium smelting process, featuring synchronously acquired video and current data for over 2.2 million samples. Leveraging cross-modal learning, the proposed FmFormer achieves state-of-the-art performance in detecting anomalies, particularly under extreme interferences such as current fluctuations and visual occlusion caused by heavy water mist. The presented methodology and benchmark may be applicable to other industrial applications with some amendments. The benchmark will be released at <a class="link-external link-https" href="https://github.com/GaochangWu/FMF-Benchmark" rel="external noopener nofollow">this https URL</a>.

Process Operation Performance Assessment Based on Multi-source Heterogeneous Information with Semi-supervised Transfer Generative Adversarial Network for Electro-fused Magnesium Furnace

Process Operation Performance Assessment Based on Semi-Supervised Fine-Grained Generative Adversarial Network for EFMF

Operating performance assessment based on multi-source heterogeneous information with deep learning for smelting process of electro-fused magnesium furnace

An Unsupervised Fault Monitoring Framework for Blast Furnace: Information Extraction Enhanced GRU-GMM-autoencoder

Fault Diagnosis of Blast Furnace Based on Incomplete Multi-Source Domain Adaptation with Feature Fusion

Application of improved EMD-Elman neural network to predict silicon content in hot metal

Multisource Information Fusion for Autoformer: Soft Sensor Modeling of FeO Content in Iron Ore Sintering Process

Data/mechanism Hybrid-Driven Modeling of Blast Furnace Smelting System and Global Sequential Optimization

A Context-Aware Enhanced GRU Network with Feature-Temporal Attention for Prediction of Silicon Content in Hot Metal

Deep Weighted Joint Distribution Adaption Network for Fault Diagnosis of Blast Furnace Ironmaking Process

Operating Performance Assessment Based on Semi-Supervised Cluster Generative Adversarial Networks for Gold Flotation Process

Novel Multimode Process Soft Sensing Methods Based on the Dynamic Mixture Variational Autoencoder Regression Model

Semi-Supervised Deep Dynamic Probabilistic Latent Variable Model for Multimode Process Soft Sensor Application

Video-based Working Condition Recognition of Fused Magnesium Furnace with Stochastic Configuration Networks

Cross-Modal Learning for Anomaly Detection in Fused Magnesium Smelting Process: Methodology and Benchmark

Sintering Quality Prediction Model Based on Semi-Supervised Dynamic Time Feature Extraction Framework

Deep Learning of Semisupervised Process Data with Hierarchical Extreme Learning Machine and Soft Sensor Application

Oxygen Content Control in the Electroslag Remelting Process: An Incremental Learning Strategy Based on Optimized Wasserstein Generative Adversarial Network with Gradient Penalty Data Augmentation

An Intelligent Fault Diagnosis Based on Adversarial Generating Module and Semi-supervised Convolutional Neural Network

Unsupervised Transfer Learning for Fault Diagnosis Across Similar Chemical Processes

Semi-supervised deep transfer learning for the microstructure recognition in the high-throughput characterization of nickel-based superalloys