TY - JOUR
T1 - Deep Unsupervised Active Learning on Learnable Graphs
AU - Ma, Handong
AU - Li, Changsheng
AU - Shi, Xinchu
AU - Yuan, Ye
AU - Wang, Guoren
N1 - Publisher Copyright:
© 2012 IEEE.
PY - 2024/2/1
Y1 - 2024/2/1
N2 - Recently, deep learning has been successfully applied to unsupervised active learning. However, the current method attempts to learn a nonlinear transformation via an auto-encoder while ignoring the sample relation, leaving huge room to design more effective representation learning mechanisms for unsupervised active learning. In this brief, we propose a novel deep unsupervised active learning model via learnable graphs, named ALLGs. ALLG benefits from learning optimal graph structures to acquire better sample representation and select representative samples. To make the learned graph structure more stable and effective, we take into account k-nearest neighbor graph as a priori and learn a relation propagation graph structure. We also incorporate shortcut connections among different layers, which can alleviate the well-known over-smoothing problem to some extent. To the best of our knowledge, this is the first attempt to leverage graph structure learning for unsupervised active learning. Extensive experiments performed on six datasets demonstrate the efficacy of our method.
AB - Recently, deep learning has been successfully applied to unsupervised active learning. However, the current method attempts to learn a nonlinear transformation via an auto-encoder while ignoring the sample relation, leaving huge room to design more effective representation learning mechanisms for unsupervised active learning. In this brief, we propose a novel deep unsupervised active learning model via learnable graphs, named ALLGs. ALLG benefits from learning optimal graph structures to acquire better sample representation and select representative samples. To make the learned graph structure more stable and effective, we take into account k-nearest neighbor graph as a priori and learn a relation propagation graph structure. We also incorporate shortcut connections among different layers, which can alleviate the well-known over-smoothing problem to some extent. To the best of our knowledge, this is the first attempt to leverage graph structure learning for unsupervised active learning. Extensive experiments performed on six datasets demonstrate the efficacy of our method.
KW - Active learning
KW - graph structure
KW - unsupervised learning
UR - http://www.scopus.com/inward/record.url?scp=85135751309&partnerID=8YFLogxK
U2 - 10.1109/TNNLS.2022.3190420
DO - 10.1109/TNNLS.2022.3190420
M3 - Article
C2 - 35895649
AN - SCOPUS:85135751309
SN - 2162-237X
VL - 35
SP - 2894
EP - 2900
JO - IEEE Transactions on Neural Networks and Learning Systems
JF - IEEE Transactions on Neural Networks and Learning Systems
IS - 2
ER -