Skip to main navigation Skip to search Skip to main content

Discrepancy-Guided Complementary Fusion for Unsupervised Multimodal Anomaly Detection

  • Taehui Lee
  • , Seyoung Jeong
  • , Sang Jun Lee*
  • *Corresponding author for this work
  • Jeonbuk National University

Research output: Contribution to journal › Journal article › peer-review

Abstract

In industrial inspection, subtle defects often appear as local variations in appearance or geometry, making reliable anomaly detection challenging. A single sensing modality can miss important defect cues, while multimodal inspection combines appearance and geometric information to represent industrial objects more comprehensively. Many existing multimodal anomaly detection methods adopt early fusion strategies that integrate features at an early stage of the network. Such early integration can dilute modality-specific anomaly responses and cause anomaly smoothing, leading to degraded detection and localization performance. To address these challenges, we propose a reconstruction-based unsupervised multimodal anomaly detection framework integrating Discrepancy-Guided Complementary Fusion (DGCF) and Noise to Feature (N2F). Specifically, DGCF reduces anomaly smoothing by exploiting cross-modal discrepancies to extract complementary information, rather than directly summing or concatenating features from different modalities. Furthermore, N2F injects Gaussian noise into the feature space to regularize feature reconstruction and encourage the decoder to learn robust normal representations. Experimental results on the MVTec 3D-AD and Eyecandies datasets demonstrate the effectiveness of the proposed method. The proposed method achieves 97.3% I-AUROC, 99.6% P-AUROC, and 97.6% AUPRO on MVTec 3D-AD, and 94.8% I-AUROC, 98.6% P-AUROC, and 93.4% AUPRO on Eyecandies.

Original languageEnglish
Article number3757
JournalSensors
Volume26
Issue number12
DOIs
StatePublished - 2026.06

Keywords

  • feature extraction
  • feature-level fusion
  • industrial anomaly detection
  • multi-sensor fusion
  • multimodal anomaly detection
  • unsupervised learning

Fingerprint

Dive into the research topics of 'Discrepancy-Guided Complementary Fusion for Unsupervised Multimodal Anomaly Detection'. Together they form a unique fingerprint.

Cite this