Prior Normality Prompt Transformer for Multiclass Industrial Image Anomaly Detection

Haiming Yao, Yunkang Cao, Wei Luo, Weihang Zhang, Wenyong Yu*, Weiming Shen

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

2 引用 (Scopus)

摘要

Image anomaly detection plays a pivotal role in industrial inspection. Traditional approaches often demand distinct models for specific categories, resulting in substantial deployment costs. This raises concerns about multiclass anomaly detection, where a unified model is developed for multiple classes. However, applying conventional methods, particularly reconstruction-based models, directly to multiclass scenarios encounters challenges, such as identical shortcut learning, hindering effective discrimination between normal and abnormal instances. To tackle this issue, our study introduces the prior normality prompt transformer (PNPT) method for multiclass image anomaly detection. PNPT strategically incorporates normal semantics prompting to mitigate the 'identical mapping' problem. This entails integrating a prior normality prompt into the reconstruction process, yielding a dual-stream model. This innovative architecture combines normal prior semantics with abnormal samples, enabling dual-stream reconstruction grounded in both prior knowledge and intrinsic sample characteristics. PNPT comprises four essential modules: 1) class-specific normality prompting pool, 2) hierarchical patch embedding, 3) semantic alignment coupling encoding, and 4) contextual semantic conditional decoding. Experimental validation on diverse benchmark datasets and real-world industrial applications highlights PNPT's superior performance in multiclass industrial anomaly detection.

源语言英语
页(从-至)11866-11876
页数11
期刊IEEE Transactions on Industrial Informatics
20
10
DOI
出版状态已出版 - 2024

指纹

探究 'Prior Normality Prompt Transformer for Multiclass Industrial Image Anomaly Detection' 的科研主题。它们共同构成独一无二的指纹。

引用此