TY - GEN
T1 - Source-Free Domain Adaptation for Medical Image Segmentation via Selectively Updated Mean Teacher
AU - Wen, Ziqi
AU - Zhang, Xinru
AU - Ye, Chuyang
N1 - Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.
PY - 2023
Y1 - 2023
N2 - Automated medical image segmentation is valuable for disease diagnosis and prognosis, and it has achieved promising performance with deep neural networks. However, a segmentation model trained on a source dataset may not perform well on a different target dataset when the distribution shift or even modality alteration exists between them. To address this problem, domain adaptation techniques can be applied to train the model with the help of the unannotated target dataset. Often when the target data is available, only a segmentation model trained on the source dataset is provided without the source data, and in this case, source-free domain adaptation (SFDA) is needed. In this work, we focus on the development of SFDA techniques for medical image segmentation, where the given source model is updated based on the target data. Since no annotations are available for the target dataset, we propose to leverage the consistency of predictions on the target data when different perturbations are made, and adopt the mean teacher framework that can effectively exploit the consistency. Moreover, we assume that the update of the entire model in vanilla mean teacher is suboptimal because when no annotated data is available the knowledge learned for segmentation in the source model can be easily forgotten. Therefore, we propose selectively updated mean teacher (SUMT), which seeks to adapt the source model parameters that are sensitive to domain variance and retain the parameters that are invariant to domains. In SUMT, we develop a progressive layer update strategy with channel-wise weight restoration that alleviates forgetting. To evaluate the proposed method, experiments were performed on three datasets, where the source and target data used different modalities for segmentation, or their images were acquired at different sites. The results show that our method improves the segmentation accuracy compared with other SFDA approaches.
AB - Automated medical image segmentation is valuable for disease diagnosis and prognosis, and it has achieved promising performance with deep neural networks. However, a segmentation model trained on a source dataset may not perform well on a different target dataset when the distribution shift or even modality alteration exists between them. To address this problem, domain adaptation techniques can be applied to train the model with the help of the unannotated target dataset. Often when the target data is available, only a segmentation model trained on the source dataset is provided without the source data, and in this case, source-free domain adaptation (SFDA) is needed. In this work, we focus on the development of SFDA techniques for medical image segmentation, where the given source model is updated based on the target data. Since no annotations are available for the target dataset, we propose to leverage the consistency of predictions on the target data when different perturbations are made, and adopt the mean teacher framework that can effectively exploit the consistency. Moreover, we assume that the update of the entire model in vanilla mean teacher is suboptimal because when no annotated data is available the knowledge learned for segmentation in the source model can be easily forgotten. Therefore, we propose selectively updated mean teacher (SUMT), which seeks to adapt the source model parameters that are sensitive to domain variance and retain the parameters that are invariant to domains. In SUMT, we develop a progressive layer update strategy with channel-wise weight restoration that alleviates forgetting. To evaluate the proposed method, experiments were performed on three datasets, where the source and target data used different modalities for segmentation, or their images were acquired at different sites. The results show that our method improves the segmentation accuracy compared with other SFDA approaches.
KW - Source-free domain adaptation
KW - medical image segmentation
KW - selectively updated mean teacher
UR - http://www.scopus.com/inward/record.url?scp=85163965409&partnerID=8YFLogxK
U2 - 10.1007/978-3-031-34048-2_18
DO - 10.1007/978-3-031-34048-2_18
M3 - Conference contribution
AN - SCOPUS:85163965409
SN - 9783031340475
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 225
EP - 236
BT - Information Processing in Medical Imaging - 28th International Conference, IPMI 2023, Proceedings
A2 - Frangi, Alejandro
A2 - de Bruijne, Marleen
A2 - Wassermann, Demian
A2 - Navab, Nassir
PB - Springer Science and Business Media Deutschland GmbH
T2 - 28th International Conference on Information Processing in Medical Imaging, IPMI 2023
Y2 - 18 June 2023 through 23 June 2023
ER -