A Global-Local Features Exchange and Fusion Network for Multi-Organ Segmentation

Zongyu Li, Yucong Lin, Danni Ai*, Jian Yang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Convolutional neural network(CNN) based methods for multi-organ segmentation have achieved impressive results. However, the global feature extraction capability of CNNs is limited due to their localisation problem. In this paper, we propose a more efficient CNN and Transformer hybrid network for abdominal multi-organ segmentation. A parallel encoder is formed by the CNN and the Transformer encoder, making full use of the local and global feature extraction capabilities of both. Based on this, feature exchange modules are inserted at each scale of the encoder to enhance the features flow and alleviate the variability between different encoder features. In addition, a feature fusion module and a feature consistency loss function are proposed to couple the output features of the two encoders to ensure the consistency of the decoder input features. Experiments based on the Synapse dataset show that our approach achieves superior results compared with both CNN-based and Transformer-based state-of-the-art methods.

Original languageEnglish
Title of host publication2023 IEEE International Symposium on Biomedical Imaging, ISBI 2023
PublisherIEEE Computer Society
ISBN (Electronic)9781665473583
DOIs
Publication statusPublished - 2023
Event20th IEEE International Symposium on Biomedical Imaging, ISBI 2023 - Cartagena, Colombia
Duration: 18 Apr 202321 Apr 2023

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2023-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference20th IEEE International Symposium on Biomedical Imaging, ISBI 2023
Country/TerritoryColombia
CityCartagena
Period18/04/2321/04/23

Keywords

  • Convolutional neural network
  • Medical Image
  • Multi-organ Segmentation
  • Transformer

Fingerprint

Dive into the research topics of 'A Global-Local Features Exchange and Fusion Network for Multi-Organ Segmentation'. Together they form a unique fingerprint.

Cite this