TY - JOUR
T1 - Self-driven continual learning for class-added motor fault diagnosis based on unseen fault detector and propensity distillation
AU - Ding, Ao
AU - Yi, Xiaojian
AU - Qin, Yong
AU - Wang, Biao
N1 - Publisher Copyright:
© 2023 Elsevier Ltd
PY - 2024/1
Y1 - 2024/1
N2 - Continual learning is a high-potential technique that enables intelligent motor fault diagnosis models to extend new diagnosable fault classes without costly training from scratch. However, existing continual learning methods have the following limitations. (1) They manually detect new faults, which is labor-intensive, untimely, and more importantly, may lead to mistaken diagnosis results. (2) They adopt the traditional knowledge distillation to align the absolute responses of old and new models, which alleviates catastrophic forgetting but restricts flexible learning from incremental datasets. To overcome the above limitations, this paper proposes a novel self-driven continual learning framework for class-added motor fault diagnosis, which can spontaneously detect unseen faults and perform more flexible continual learning from incremental datasets. For the automatic detection of unseen faults, after collecting online samples, adversarial training with exemplars of each seen class is conducted to measure the class separability. The truth fault classes that are unseen for diagnosis models can be clearly distinguished from all seen classes, and correspondingly missed diagnosis or misdiagnosing can be avoided effectively and incremental samples with new fault types can be collected quickly. For the flexible continual learning strategy, a more flexible knowledge distillation is proposed to preserve the prediction propensity rather than the absolute response. This strategy not only keeps the recognition performance of old classes but also loosens unnecessary constraints and increases the diagnosis model plasticity to learn new knowledge from incremental datasets, thus improving the accuracy of motor fault diagnosis during continual learning. The effectiveness of the proposed method is verified by conducting fault simulation experiments of three-phase motors and its superiority is also demonstrated by comparing it with some state-of-the-art diagnosis methods.
AB - Continual learning is a high-potential technique that enables intelligent motor fault diagnosis models to extend new diagnosable fault classes without costly training from scratch. However, existing continual learning methods have the following limitations. (1) They manually detect new faults, which is labor-intensive, untimely, and more importantly, may lead to mistaken diagnosis results. (2) They adopt the traditional knowledge distillation to align the absolute responses of old and new models, which alleviates catastrophic forgetting but restricts flexible learning from incremental datasets. To overcome the above limitations, this paper proposes a novel self-driven continual learning framework for class-added motor fault diagnosis, which can spontaneously detect unseen faults and perform more flexible continual learning from incremental datasets. For the automatic detection of unseen faults, after collecting online samples, adversarial training with exemplars of each seen class is conducted to measure the class separability. The truth fault classes that are unseen for diagnosis models can be clearly distinguished from all seen classes, and correspondingly missed diagnosis or misdiagnosing can be avoided effectively and incremental samples with new fault types can be collected quickly. For the flexible continual learning strategy, a more flexible knowledge distillation is proposed to preserve the prediction propensity rather than the absolute response. This strategy not only keeps the recognition performance of old classes but also loosens unnecessary constraints and increases the diagnosis model plasticity to learn new knowledge from incremental datasets, thus improving the accuracy of motor fault diagnosis during continual learning. The effectiveness of the proposed method is verified by conducting fault simulation experiments of three-phase motors and its superiority is also demonstrated by comparing it with some state-of-the-art diagnosis methods.
KW - Adversarial training
KW - Continual learning
KW - Motor fault diagnosis
KW - Propensity distillation
KW - Unseen fault detection
UR - http://www.scopus.com/inward/record.url?scp=85175826024&partnerID=8YFLogxK
U2 - 10.1016/j.engappai.2023.107382
DO - 10.1016/j.engappai.2023.107382
M3 - Article
AN - SCOPUS:85175826024
SN - 0952-1976
VL - 127
JO - Engineering Applications of Artificial Intelligence
JF - Engineering Applications of Artificial Intelligence
M1 - 107382
ER -