Abstract:Recent studies of multimodal industrial anomaly detection (IAD) based on 3D point clouds and RGB images have highlighted the importance of exploiting the redundancy and complementarity among modalities for accurate classification and segmentation. However, achieving multimodal IAD in practical production lines remains a work in progress. It is essential to consider the trade-offs between the costs and benefits associated with the introduction of new modalities while ensuring compatibility with current processes. Existing quality control processes combine rapid in-line inspections, such as optical and infrared imaging with high-resolution but time-consuming near-line characterization techniques, including industrial CT and electron microscopy to manually or semi-automatically locate and analyze defects in the production of Li-ion batteries and composite materials. Given the cost and time limitations, only a subset of the samples can be inspected by all in-line and near-line methods, and the remaining samples are only evaluated through one or two forms of in-line inspection. To fully exploit data for deep learning-driven automatic defect detection, the models must have the ability to leverage multimodal training and handle incomplete modalities during inference. In this paper, we propose CMDIAD, a Cross-Modal Distillation framework for IAD to demonstrate the feasibility of a Multi-modal Training, Few-modal Inference (MTFI) pipeline. Our findings show that the MTFI pipeline can more effectively utilize incomplete multimodal information compared to applying only a single modality for training and inference. Moreover, we investigate the reasons behind the asymmetric performance improvement using point clouds or RGB images as the main modality of inference. This provides a foundation for our future multimodal dataset construction with additional modalities from manufacturing scenarios.

Multimodal Industrial Anomaly Detection by Crossmodal Feature Mapping

Multimodal Industrial Anomaly Detection via Hybrid Fusion

Incomplete Multimodal Industrial Anomaly Detection via Cross-Modal Distillation

Multimodal Industrial Anomaly Detection by Crossmodal Reverse Distillation

A Diffusion-Based Framework for Multi-Class Anomaly Detection

A Collaborative Anomaly Localization Method Based on Multi-Modal Images

Cross-Modality 3D Multi-Object Tracking under Adverse Weather Via Adaptive Hard Sample Mining

VMAD: Visual-enhanced Multimodal Large Language Model for Zero-Shot Anomaly Detection

Test Time Training for Industrial Anomaly Segmentation

RADAR: Robust Two-stage Modality-incomplete Industrial Anomaly Detection

Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Data

Exploring Large Vision-Language Models for Robust and Efficient Industrial Anomaly Detection

Incremental Template Neighborhood Matching for 3D Anomaly Detection

A Survey on RGB, 3D, and Multimodal Approaches for Unsupervised Industrial Anomaly Detection

Multi-modal background-aware for defect semantic segmentation with limited data

Towards Efficient Cross-Modal Anomaly Detection Using Triple-Adaptive Network and Bi-Quintuple Contrastive Learning

Learning Multi-view Anomaly Detection

Complementary Pseudo Multimodal Feature for Point Cloud Anomaly Detection

Myriad: Large Multimodal Model by Applying Vision Experts for Industrial Anomaly Detection

GeneralAD: Anomaly Detection Across Domains by Attending to Distorted Features

Self-supervised Feature Adaptation for 3D Industrial Anomaly Detection