Prior Normality Prompt Transformer for Multiclass Industrial Image Anomaly Detection

Haiming Yao, Yunkang Cao, Wei Luo, Weihang Zhang, Wenyong Yu*, Weiming Shen

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Image anomaly detection plays a pivotal role in industrial inspection. Traditional approaches often demand distinct models for specific categories, resulting in substantial deployment costs. This raises concerns about multiclass anomaly detection, where a unified model is developed for multiple classes. However, applying conventional methods, particularly reconstruction-based models, directly to multiclass scenarios encounters challenges, such as identical shortcut learning, hindering effective discrimination between normal and abnormal instances. To tackle this issue, our study introduces the prior normality prompt transformer (PNPT) method for multiclass image anomaly detection. PNPT strategically incorporates normal semantics prompting to mitigate the 'identical mapping' problem. This entails integrating a prior normality prompt into the reconstruction process, yielding a dual-stream model. This innovative architecture combines normal prior semantics with abnormal samples, enabling dual-stream reconstruction grounded in both prior knowledge and intrinsic sample characteristics. PNPT comprises four essential modules: 1) class-specific normality prompting pool, 2) hierarchical patch embedding, 3) semantic alignment coupling encoding, and 4) contextual semantic conditional decoding. Experimental validation on diverse benchmark datasets and real-world industrial applications highlights PNPT's superior performance in multiclass industrial anomaly detection.

Original languageEnglish
Pages (from-to)11866-11876
Number of pages11
JournalIEEE Transactions on Industrial Informatics
Volume20
Issue number10
DOIs
Publication statusPublished - 2024

Keywords

  • Defect detection
  • image anomaly detection
  • prompting
  • vision Transformer (ViT)

Fingerprint

Dive into the research topics of 'Prior Normality Prompt Transformer for Multiclass Industrial Image Anomaly Detection'. Together they form a unique fingerprint.

Cite this