TransU²-Net: An Effective Medical Image Segmentation Framework Based on Transformer and U²-Net

Background: In the past few years, U-Net based U-shaped architecture and skip-connections have made incredible progress in the field of medical image segmentation. U
²
-Net achieves good performance in computer vision. However, in the medical image segmentation task, U
²
-Net with over nesting is easy to overfit. Purpose: A 2D network structure TransU
²
-Net combining transformer and a lighter weight U
²
-Net is proposed for automatic segmentation of brain tumor magnetic resonance image (MRI). Methods: The light-weight U
²
-Net architecture not only obtains multi-scale information but also reduces redundant feature extraction. Meanwhile, the transformer block embedded in the stacked convolutional layer obtains more global information; the transformer with skip-connection enhances spatial domain information representation. A new multi-scale feature map fusion strategy as a postprocessing method was proposed for better fusing high and low-dimensional spatial information. Results: Our proposed model TransU
²
-Net achieves better segmentation results, on the BraTS2021 dataset, our method achieves an average dice coefficient of 88.17%; Evaluation on the publicly available MSD dataset, we perform tumor evaluation, we achieve a dice coefficient of 74.69%; in addition to comparing the TransU
²
-Net results are compared with previously proposed 2D segmentation methods. Conclusions: We propose an automatic medical image segmentation method combining transformers and U
²
-Net, which has good performance and is of clinical importance. The experimental results show that the proposed method outperforms other 2D medical image segmentation methods.
Clinical Translation Statement
: We use the BarTS2021 dataset and the MSD dataset which are publicly available databases. All experiments in this paper are in accordance with medical ethics.