TY - JOUR
T1 - Out-of-distribution detection-assisted trustworthy machinery fault diagnosis approach with uncertainty-aware deep ensembles
AU - Han, Te
AU - Li, Yan Fu
N1 - Publisher Copyright:
© 2022 Elsevier Ltd
PY - 2022/10
Y1 - 2022/10
N2 - Recent intelligent fault diagnosis technologies can effectively identify the machinery health condition, while they are learnt based on a closed-world assumption, i.e., the training and testing data follow independently identically distribution (IID). However, in real-world diagnosis, the monitored samples are often from unknown distributions, such as unseen machine faults, leading to an out-of-distribution (OOD) problem. This is a challenging issue that may induce the model to produce unreliable and unsafe decision for unforeseen machine data. To tackle this problem, a novel OOD detection-assisted trustworthy machinery fault diagnosis approach is developed to enhance the reliability and safety of intelligent models. First, multiple deep neural networks are integrated to establish an ensemble diagnosis system, called deep ensembles. Then, the trustworthy analysis with uncertainty-aware deep ensembles is conducted to detect the OOD samples and issue the warnings for the potential untrustworthy diagnosis. A selection criterion of uncertainty threshold is given. Finally, the trustworthy decisions are achieved by comprehensively considering the deep ensembles’ prediction and uncertainty. The proposed trustworthy fault diagnosis approach is validated in two case studies, exhibiting significant advantages for diagnosing OOD samples.
AB - Recent intelligent fault diagnosis technologies can effectively identify the machinery health condition, while they are learnt based on a closed-world assumption, i.e., the training and testing data follow independently identically distribution (IID). However, in real-world diagnosis, the monitored samples are often from unknown distributions, such as unseen machine faults, leading to an out-of-distribution (OOD) problem. This is a challenging issue that may induce the model to produce unreliable and unsafe decision for unforeseen machine data. To tackle this problem, a novel OOD detection-assisted trustworthy machinery fault diagnosis approach is developed to enhance the reliability and safety of intelligent models. First, multiple deep neural networks are integrated to establish an ensemble diagnosis system, called deep ensembles. Then, the trustworthy analysis with uncertainty-aware deep ensembles is conducted to detect the OOD samples and issue the warnings for the potential untrustworthy diagnosis. A selection criterion of uncertainty threshold is given. Finally, the trustworthy decisions are achieved by comprehensively considering the deep ensembles’ prediction and uncertainty. The proposed trustworthy fault diagnosis approach is validated in two case studies, exhibiting significant advantages for diagnosing OOD samples.
KW - Ensemble deep learning
KW - Out-of-distribution detection
KW - Trustworthy fault diagnosis
KW - Uncertainty
KW - Unseen fault
UR - http://www.scopus.com/inward/record.url?scp=85132859561&partnerID=8YFLogxK
U2 - 10.1016/j.ress.2022.108648
DO - 10.1016/j.ress.2022.108648
M3 - Article
AN - SCOPUS:85132859561
SN - 0951-8320
VL - 226
JO - Reliability Engineering and System Safety
JF - Reliability Engineering and System Safety
M1 - 108648
ER -