FCTrans UNet: A Hybrid CNN and Transformer Model for Medical Image Segmentations

Haoran Cheng, Mengyu Zhu*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Medical image segmentation plays a pivotal role in isolating the region of interest, significantly advancing the field of medicine, particularly in the diagnosis and treatment of diseases. Convolutional neural networks (CNNs), such as U-Net, have attained significant success in medical image segmentation tasks. However, they are limited in establishing long-range dependencies due to the constrained sensory field of convolutional operations. Recently, researchers have proposed TransUnet to address the limitations of convolutional neural networks in establishing long-term dependencies and global contextual connections. This paper introduces a hybrid network model, feature-concatenate TransUNet (FCTransUNet) to present a improvement to the original TransUNet. To enhance the fusion of features in the encoder and decoder components, a feature fusion module (CSFFM) is introduced. Additionally, a feature extraction module (SFE) is incorporated into the decoder part to bolster feature extraction, thereby improving accuracy in multi-organ image segmentation.

Original languageEnglish
Title of host publication2024 5th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1277-1282
Number of pages6
ISBN (Electronic)9798350385557
DOIs
Publication statusPublished - 2024
Event5th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2024 - Hybrid, Nanjing, China
Duration: 29 May 202431 May 2024

Publication series

Name2024 5th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2024

Conference

Conference5th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2024
Country/TerritoryChina
CityHybrid, Nanjing
Period29/05/2431/05/24

Keywords

  • CNN
  • component
  • feature enhancement
  • feature fusion
  • multiorgan segmentation
  • transformer

Fingerprint

Dive into the research topics of 'FCTrans UNet: A Hybrid CNN and Transformer Model for Medical Image Segmentations'. Together they form a unique fingerprint.

Cite this