TY - GEN
T1 - Semi-supervised Brain Lesion Segmentation with an Adapted Mean Teacher Model
AU - Cui, Wenhui
AU - Liu, Yanlin
AU - Li, Yuxing
AU - Guo, Menghao
AU - Li, Yiming
AU - Li, Xiuli
AU - Wang, Tianle
AU - Zeng, Xiangzhu
AU - Ye, Chuyang
N1 - Publisher Copyright:
© 2019, Springer Nature Switzerland AG.
PY - 2019
Y1 - 2019
N2 - Automated brain lesion segmentation provides valuable information for the analysis and intervention of patients. In particular, methods that are based on convolutional neural networks (CNNs) have achieved state-of-the-art segmentation performance. However, CNNs usually require a decent amount of annotated data, which may be costly and time-consuming to obtain. Since unannotated data is generally abundant, it is desirable to use unannotated data to improve the segmentation performance for CNNs when limited annotated data is available. In this work, we propose a semi-supervised learning (SSL) approach to brain lesion segmentation, where unannotated data is incorporated into the training of CNNs. We adapt the mean teacher model, which is originally developed for SSL-based image classification, for brain lesion segmentation. Assuming that the network should produce consistent outputs for similar inputs, a loss of segmentation consistency is designed and integrated into a self-ensembling framework. Self-ensembling exploits the information in the intermediate training steps, and the ensemble prediction based on the information can be closer to the correct result than the single latest model. To exploit such information, we build a student model and a teacher model, which share the same CNN architecture for segmentation. The student and teacher models are updated alternately. At each step, the student model learns from the teacher model by minimizing the weighted sum of the segmentation loss computed from annotated data and the segmentation consistency loss between the teacher and student models computed from unannotated data. Then, the teacher model is updated by combining the updated student model with the historical information of teacher models using an exponential moving average strategy. For demonstration, the proposed approach was evaluated on ischemic stroke lesion segmentation. Results indicate that the proposed method improves stroke lesion segmentation with the incorporation of unannotated data and outperforms competing SSL-based methods.
AB - Automated brain lesion segmentation provides valuable information for the analysis and intervention of patients. In particular, methods that are based on convolutional neural networks (CNNs) have achieved state-of-the-art segmentation performance. However, CNNs usually require a decent amount of annotated data, which may be costly and time-consuming to obtain. Since unannotated data is generally abundant, it is desirable to use unannotated data to improve the segmentation performance for CNNs when limited annotated data is available. In this work, we propose a semi-supervised learning (SSL) approach to brain lesion segmentation, where unannotated data is incorporated into the training of CNNs. We adapt the mean teacher model, which is originally developed for SSL-based image classification, for brain lesion segmentation. Assuming that the network should produce consistent outputs for similar inputs, a loss of segmentation consistency is designed and integrated into a self-ensembling framework. Self-ensembling exploits the information in the intermediate training steps, and the ensemble prediction based on the information can be closer to the correct result than the single latest model. To exploit such information, we build a student model and a teacher model, which share the same CNN architecture for segmentation. The student and teacher models are updated alternately. At each step, the student model learns from the teacher model by minimizing the weighted sum of the segmentation loss computed from annotated data and the segmentation consistency loss between the teacher and student models computed from unannotated data. Then, the teacher model is updated by combining the updated student model with the historical information of teacher models using an exponential moving average strategy. For demonstration, the proposed approach was evaluated on ischemic stroke lesion segmentation. Results indicate that the proposed method improves stroke lesion segmentation with the incorporation of unannotated data and outperforms competing SSL-based methods.
KW - Brain lesion segmentation
KW - Mean teacher model
KW - Semi-supervised learning
UR - http://www.scopus.com/inward/record.url?scp=85066153514&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-20351-1_43
DO - 10.1007/978-3-030-20351-1_43
M3 - Conference contribution
AN - SCOPUS:85066153514
SN - 9783030203504
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 554
EP - 565
BT - Information Processing in Medical Imaging - 26th International Conference, IPMI 2019, Proceedings
A2 - Bao, Siqi
A2 - Chung, Albert C.S.
A2 - Gee, James C.
A2 - Yushkevich, Paul A.
PB - Springer Verlag
T2 - 26th International Conference on Information Processing in Medical Imaging, IPMI 2019
Y2 - 2 June 2019 through 7 June 2019
ER -